Skip to content

Models

Response object containing full details about a registered custom model including health status.

Example Usage

typescript
import { Models } from "@meetkai/mka1/models/operations";

let value: Models = {
  id: "<id>",
  name: "<value>",
  baseUrl: "https://wealthy-yogurt.org",
  capabilities: {
    chat: false,
    completion: true,
    embedding: false,
    image: true,
    transcription: true,
    speech: false,
  },
  isAvailable: false,
  lastHealthCheck: new Date("2023-06-19T10:08:38.209Z"),
  createdAt: new Date("2024-12-24T22:49:58.140Z"),
  updatedAt: new Date("2024-12-20T02:11:19.910Z"),
};

Fields

FieldTypeRequiredDescription
idstring✔️Unique identifier for this custom model
namestring✔️Name of the custom model
baseUrlstring✔️Base URL of the custom model API endpoint
capabilitiesoperations.ListCustomModelsCapabilities✔️Object describing the capabilities of this custom model
maxTokensnumberDefault maximum tokens for generation
contextWindownumberContext window size (total tokens)
temperaturenumberDefault temperature setting (0-2)
topPnumberDefault nucleus sampling parameter (0-1)
frequencyPenaltynumberDefault frequency penalty (-2 to 2)
presencePenaltynumberDefault presence penalty (-2 to 2)
rpmnumberRate limit in requests per minute
isAvailableboolean✔️Whether the model is currently available and passing health checks
lastHealthCheckDate✔️Timestamp of the most recent health check
healthCheckErrorstringError message from the last health check, if the check failed
createdAtDate✔️Timestamp when this custom model was registered
updatedAtDate✔️Timestamp when this custom model configuration was last updated