AI Evaluation API

28 endpoints in the AI Evaluation group of the TestLookup API.

Operations

• POST /api/v1/ai-eval/agent-stack-release-gate — Run Agent Stack Release Gate · undocumented response
• GET /api/v1/ai-eval/agent-stack-release-gate/runs — List Agent Stack Gate Runs
• GET /api/v1/ai-eval/baselines — List Baselines · undocumented response
• POST /api/v1/ai-eval/baselines — Set Baseline · undocumented response
• GET /api/v1/ai-eval/candidate-options — Get Candidate Options
• GET /api/v1/ai-eval/dashboard — Get Quality Dashboard
• GET /api/v1/ai-eval/datasets — List Datasets
• POST /api/v1/ai-eval/datasets — Create Dataset
• DELETE /api/v1/ai-eval/datasets/{dataset_id} — Delete Dataset
• POST /api/v1/ai-eval/datasets/from-feedback — Create Dataset From Feedback
• GET /api/v1/ai-eval/drift — Get Drift · undocumented response
• GET /api/v1/ai-eval/gates/{checksum} — Get Eval Manifest
• POST /api/v1/ai-eval/golden-datasets/seed — Seed Golden Datasets · undocumented response
• GET /api/v1/ai-eval/label-health — Get Training Label Health · undocumented response
• POST /api/v1/ai-eval/pre-release-gate — Run Pre Release Gate · undocumented response
• GET /api/v1/ai-eval/report-cycles — List Report Eval Cycles · undocumented response
• POST /api/v1/ai-eval/report-cycles — Create Report Eval Cycle · undocumented response
• GET /api/v1/ai-eval/report-cycles/readiness — Get Report Eval Readiness · undocumented response
• POST /api/v1/ai-eval/reviewer-quality — Run Reviewer Quality · undocumented response
• GET /api/v1/ai-eval/reviewer-quality/runs — List Reviewer Quality Runs
• GET /api/v1/ai-eval/runs — List Eval Runs
• GET /api/v1/ai-eval/runs/{eval_run_id} — Get Eval Run
• GET /api/v1/ai-eval/runs/{eval_run_id}/items — List Eval Run Items
• POST /api/v1/ai-eval/runs/evaluate/{dataset_id} — Run Evaluation
• GET /api/v1/ai-eval/shadow-pairs — List Shadow Pairs
• POST /api/v1/ai-eval/shadow-pairs/{shadow_pair_id}/label — Label Shadow Pair
• POST /api/v1/ai-eval/tier-comparison — Run Tier Comparison · undocumented response
• GET /api/v1/ai-eval/tier-comparison/runs — List Tier Comparison Runs