ReviewerQualityRunRead

Fields

An AIEvalReviewerQuality row WITHOUT its observation arrays.

20 fields

agent_id · required

string

auto_disable_applied · required

boolean

auto_disable_eligible · required

boolean

clean_sample_count · required

integer

deterministic_recall

number or null

evaluated_at · required

string (date-time)

false_flag_rate

number or null

false_omission_rate

number or null

human_outcome_count · required

integer

id · required

string (uuid)

metrics · required

array of object

project_id · required

string (uuid)

recall_delta

number or null

regressions · required

array of object

second_model_recall

number or null

semantic_sample_counts · required

object

source · required

string

status · required

string

window_ended_at · required

string (date-time)

window_started_at · required

string (date-time)

Raw schema (JSON)

{
  "description": "An ``AIEvalReviewerQuality`` row WITHOUT its observation arrays (W16).",
  "properties": {
    "agent_id": {
      "title": "Agent Id",
      "type": "string"
    },
    "auto_disable_applied": {
      "title": "Auto Disable Applied",
      "type": "boolean"
    },
    "auto_disable_eligible": {
      "title": "Auto Disable Eligible",
      "type": "boolean"
    },
    "clean_sample_count": {
      "title": "Clean Sample Count",
      "type": "integer"
    },
    "deterministic_recall": {
      "anyOf": [
        {
          "type": "number"
        },
        {
          "type": "null"
        }
      ],
      "title": "Deterministic Recall"
    },
    "evaluated_at": {
      "format": "date-time",
      "title": "Evaluated At",
      "type": "string"
    },
    "false_flag_rate": {
      "anyOf": [
        {
          "type": "number"
        },
        {
          "type": "null"
        }
      ],
      "title": "False Flag Rate"
    },
    "false_omission_rate": {
      "anyOf": [
        {
          "type": "number"
        },
        {
          "type": "null"
        }
      ],
      "title": "False Omission Rate"
    },
    "human_outcome_count": {
      "title": "Human Outcome Count",
      "type": "integer"
    },
    "id": {
      "format": "uuid",
      "title": "Id",
      "type": "string"
    },
    "metrics": {
      "items": {
        "additionalProperties": true,
        "type": "object"
      },
      "title": "Metrics",
      "type": "array"
    },
    "project_id": {
      "format": "uuid",
      "title": "Project Id",
      "type": "string"
    },
    "recall_delta": {
      "anyOf": [
        {
          "type": "number"
        },
        {
          "type": "null"
        }
      ],
      "title": "Recall Delta"
    },
    "regressions": {
      "items": {
        "additionalProperties": true,
        "type": "object"
      },
      "title": "Regressions",
      "type": "array"
    },
    "second_model_recall": {
      "anyOf": [
        {
          "type": "number"
        },
        {
          "type": "null"
        }
      ],
      "title": "Second Model Recall"
    },
    "semantic_sample_counts": {
      "additionalProperties": true,
      "title": "Semantic Sample Counts",
      "type": "object"
    },
    "source": {
      "title": "Source",
      "type": "string"
    },
    "status": {
      "title": "Status",
      "type": "string"
    },
    "window_ended_at": {
      "format": "date-time",
      "title": "Window Ended At",
      "type": "string"
    },
    "window_started_at": {
      "format": "date-time",
      "title": "Window Started At",
      "type": "string"
    }
  },
  "required": [
    "id",
    "project_id",
    "agent_id",
    "source",
    "status",
    "window_started_at",
    "window_ended_at",
    "evaluated_at",
    "metrics",
    "regressions",
    "semantic_sample_counts",
    "clean_sample_count",
    "human_outcome_count",
    "auto_disable_eligible",
    "auto_disable_applied"
  ],
  "title": "ReviewerQualityRunRead",
  "type": "object"
}

Used by endpoints

One endpoint sends or returns this schema, on its own or inside another schema.

• GET /api/v1/ai-eval/reviewer-quality/runs — List Reviewer Quality Runs

Used by schemas

• ReviewerQualityRunListResponse

More details

• Specification: OpenAPI JSON