Create Conversation Eval
Create the built-in Conversation Eval that uses the real reply engine.
Use this operation when you need an actual scripted dialogue, not the static authored-config
check at POST /characters/{slug}/evals. It scores deterministic assertions
(forbidden-leakage / memory-recall / per-turn contains) plus LLM-judge rubrics. Async: returns
an eval_id; poll get_conversation_eval for the terminal result, transcript, and scored report.
Authentication
AuthorizationBearer
LoreOS runtime API key (ck_...), sent as Authorization: Bearer <key>.
Path parameters
slug
Request
This endpoint expects an object.
name
turns
seed_context
Context events planted before turn 1 (e.g. a fact to test leak).
assertions
reply_mode
Response
Successful Response
schema_version
LoreOS success-envelope version.
data
next_actions
Concrete follow-up API actions; empty when no action is required.
Errors
422
Unprocessable Entity Error