TierOutputPairRequest

Fields

9 fields

candidate_cost_usd

number

candidate_latency_ms

integer

candidate_output · required

object

candidate_tokens

integer

incumbent_cost_usd

number

incumbent_latency_ms

integer

incumbent_output · required

object

incumbent_tokens

integer

sample_id · required

string

Raw schema (JSON)

{
  "additionalProperties": false,
  "properties": {
    "candidate_cost_usd": {
      "default": 0,
      "minimum": 0,
      "title": "Candidate Cost Usd",
      "type": "number"
    },
    "candidate_latency_ms": {
      "default": 0,
      "minimum": 0,
      "title": "Candidate Latency Ms",
      "type": "integer"
    },
    "candidate_output": {
      "title": "Candidate Output"
    },
    "candidate_tokens": {
      "default": 0,
      "minimum": 0,
      "title": "Candidate Tokens",
      "type": "integer"
    },
    "incumbent_cost_usd": {
      "default": 0,
      "minimum": 0,
      "title": "Incumbent Cost Usd",
      "type": "number"
    },
    "incumbent_latency_ms": {
      "default": 0,
      "minimum": 0,
      "title": "Incumbent Latency Ms",
      "type": "integer"
    },
    "incumbent_output": {
      "title": "Incumbent Output"
    },
    "incumbent_tokens": {
      "default": 0,
      "minimum": 0,
      "title": "Incumbent Tokens",
      "type": "integer"
    },
    "sample_id": {
      "maxLength": 160,
      "minLength": 1,
      "title": "Sample Id",
      "type": "string"
    }
  },
  "required": [
    "sample_id",
    "incumbent_output",
    "candidate_output"
  ],
  "title": "TierOutputPairRequest",
  "type": "object"
}

Used by endpoints

One endpoint sends or returns this schema, on its own or inside another schema.

• POST /api/v1/ai-eval/tier-comparison — Run Tier Comparison

Used by schemas

• TierComparisonRequest

More details

• Specification: OpenAPI JSON