Run Evaluation — POST /api/v1/ai-eval/runs/evaluate/{dataset_id}
Run Evaluation
Run evaluation against a dataset (ADMIN only).
Endpoint: POST /api/v1/ai-eval/runs/evaluate/{dataset_id}
Authentication: Send a signed-in user’s access token in Authorization: Bearer <access token>, or an API key in X-API-Key: <API key>.
- Your role must be Admin or higher.
Parameters
Section titled “Parameters”| Name | In | Required | Type | Default | Description |
|---|---|---|---|---|---|
dataset_id | path | yes | string (uuid) | ||
X-API-Key | header | no | string or null | API key, as an alternative to the access token (see Authentication). |
Request body
Section titled “Request body”| Content type | Body | Required |
|---|---|---|
application/json | CandidateEvaluationRequest or null | no |
Responses
Section titled “Responses”| Status | Meaning | Body |
|---|---|---|
201 | Successful Response | AIEvalRunResponse (application/json) |
202 | Accepted | CandidateEvaluationAccepted (application/json) |
422 | Validation Error | HTTPValidationError (application/json) |
Errors this endpoint returns, read from its source code:
404, with the message “Dataset not found”
It can also return 401 if your credential is missing or expired, 403 if your credential does not allow this request, and 404 if the item does not exist or you cannot see it. Your role, your project membership and the key’s scope decide what a credential allows. See Errors and retries.
More details
Section titled “More details”- Group: AI Evaluation
- Operation ID:
run_evaluation_api_v1_ai_eval_runs_evaluate__dataset_id__post - Source code:
backend/app/routers/ai_evaluation.py, line 258 - Specification: OpenAPI JSON