EvalPythonGrader
Example Usage
typescript
import { EvalPythonGrader } from "@meetkai/mka1/models/components";
let value: EvalPythonGrader = {
type: "python",
};Fields
| Field | Type | Required | Description |
|---|---|---|---|
type | "python" | ✔️ | N/A |
contract | components.EvalPythonGraderContract | ➖ | N/A |
execution | components.EvalPythonGraderExecution | ➖ | N/A |
modelAccess | components.EvalPythonGraderModelAccess | ➖ | N/A |
metricId | string | ➖ | Default metric key used when grade returns a single float. |
source | string | ➖ | Inline Python source that defines a supported eval grading contract. |
fileId | string | ➖ | File ID for a Python grader uploaded with purpose 'evals'. |
timeoutSeconds | number | ➖ | N/A |
maxModelCalls | number | ➖ | N/A |