Skip to content

EmbeddingModelLimits

Limits for the embedding model

Example Usage

typescript
import { EmbeddingModelLimits } from "@meetkai/mka1/models/components";

let value: EmbeddingModelLimits = {
  maxBatchSize: 6701.34,
  maxInputTokens: 3822.16,
  maxInputLength: 8250.53,
};

Fields

FieldTypeRequiredDescription
maxBatchSizenumber✔️Maximum number of inputs allowed in a single batch request
maxInputTokensnumber✔️Maximum tokens per individual input (derived from contextWindow)
maxInputLengthnumber✔️Maximum characters per individual input (contextWindow * 2)