CustomModelResponse

Response object containing full details about a registered custom model including health status.

Example Usage

import { CustomModelResponse } from "@meetkai/mka1/models/components";

let value: CustomModelResponse = {
  id: "cm_abc123",
  name: "my-local-llama",
  baseUrl: "http://localhost:8080/v1",
  capabilities: {
    chat: true,
    completion: true,
    embedding: false,
    image: false,
    transcription: false,
    speech: false,
  },
  contextWindow: 4096,
  temperature: 0.7,
  isAvailable: true,
  lastHealthCheck: new Date("2024-01-15T10:30:00Z"),
  createdAt: new Date("2024-01-01T00:00:00Z"),
  updatedAt: new Date("2024-01-15T10:30:00Z"),
};

Fields

Field	Type	Required	Description
id	string	✔️	Unique identifier for this custom model
name	string	✔️	Name of the custom model
baseUrl	string	✔️	Base URL of the custom model API endpoint
capabilities	components.Capabilities	✔️	Object describing the capabilities of this custom model
maxTokens	number	➖	Default maximum tokens for generation
contextWindow	number	➖	Context window size (total tokens)
temperature	number	➖	Default temperature setting (0-2)
topP	number	➖	Default nucleus sampling parameter (0-1)
frequencyPenalty	number	➖	Default frequency penalty (-2 to 2)
presencePenalty	number	➖	Default presence penalty (-2 to 2)
rpm	number	➖	Rate limit in requests per minute
isAvailable	boolean	✔️	Whether the model is currently available and passing health checks
lastHealthCheck	Date	✔️	Timestamp of the most recent health check
healthCheckError	string	➖	Error message from the last health check, if the check failed
createdAt	Date	✔️	Timestamp when this custom model was registered
updatedAt	Date	✔️	Timestamp when this custom model configuration was last updated