Create Conversation Eval

Run a scripted conversation against the real reply engine, then score deterministic assertions (forbidden-leakage / memory-recall / per-turn contains) + LLM-judge rubrics. Async: returns an eval_id; poll the GET below for the scored report.

Authentication

AuthorizationBearer

LoreOS API key, sent as Authorization: Bearer <key>.

Path parameters

slugstringRequired

Request

This endpoint expects an object.

namestringRequired1-200 characters

turnslist of objectsRequired

seed_contextlist of objects or nullOptional

Context events planted before turn 1 (e.g. a fact to test leak).

assertionsobjectOptional

reply_modeenumOptionalDefaults to deep

Response

Successful Response

Errors

422

Unprocessable Entity Error

$	curl -X POST https://api.loreos.app/v1/characters/slug/conversation-evals \
>	-H "Authorization: Bearer <token>" \
>	-H "Content-Type: application/json" \
>	-d '{
>	"name": "Test Conversation Eval for Detective Character",
>	"turns": [
>	{
>	"user_text": "Can you tell me about the case you are working on?"
>	},
>	{
>	"user_text": "What clues have you found so far?"
>	},
>	{
>	"user_text": "Do you suspect anyone in particular?"
>	}
>	]
>	}'