Skip to content

RerunFailedEvalSamplesResponseBody ​

OK

Example Usage ​

typescript
import { RerunFailedEvalSamplesResponseBody } from "@meetkai/mka1/models/operations";

let value: RerunFailedEvalSamplesResponseBody = {
  id: "<id>",
  object: "eval.run",
  suiteId: "<id>",
  suiteVersion: 94734,
  suiteVersionId: "<id>",
  orgId: "<id>",
  teamId: "<id>",
  status: "cancelling",
  models: [
    "<value 1>",
    "<value 2>",
  ],
  taskIds: [],
  judgeModel: "<value>",
  embeddingModel: "<value>",
  generation: {},
  requestCounts: {
    total: 87962,
    completed: 486195,
    failed: 641248,
  },
  metrics: {},
  error: {
    "key": "<value>",
    "key1": "<value>",
  },
  artifactFileIds: [
    "<value 1>",
    "<value 2>",
  ],
  metadata: {
    "key": "<value>",
    "key1": "<value>",
  },
  agentName: null,
  agentVersion: "<value>",
  agentEffort: null,
  costUsd: 7569.64,
  createdAt: 882868,
  startedAt: 616068,
  completedAt: 744118,
  cancelledAt: null,
  failedAt: 239910,
};

Fields ​

FieldTypeRequiredDescription
idstring✔️N/A
object"eval.run"✔️N/A
suiteIdstring✔️N/A
suiteVersionnumber✔️N/A
suiteVersionIdstring✔️N/A
orgIdstring✔️The org that owns this run.
teamIdstring✔️The team that owns this run.
statuscomponents.EvalRunStatus✔️N/A
modelsstring[]✔️N/A
taskIdsstring[]✔️N/A
judgeModelstring✔️N/A
embeddingModelstring✔️N/A
generationoperations.RerunFailedEvalSamplesGeneration✔️N/A
requestCountsoperations.RerunFailedEvalSamplesRequestCounts✔️N/A
metricsRecord<string, any>✔️N/A
errorRecord<string, any>✔️N/A
artifactFileIdsstring[]✔️N/A
metadataRecord<string, string>✔️N/A
agentNamestring✔️Coding-agent harness that produced this run (e.g. omp, claude-code). Null for every non-harness eval kind — a null here is not a missing value, it means the run is not an agent run.
agentVersionstring✔️Version of agent_name, as the harness reported it. Null when agent_name is.
agentEffortstring✔️Reasoning-effort setting the agent ran at (e.g. medium, xhigh). Part of the leaderboard's row identity: the same agent and model at two efforts are two rows, not one. Null when agent_name is.
costUsdnumber✔️Total spend for the run in USD. Null when the harness did not report cost.
createdAtnumber✔️N/A
startedAtnumber✔️N/A
completedAtnumber✔️N/A
cancelledAtnumber✔️N/A
failedAtnumber✔️N/A