maxInputTokens property

int? maxInputTokens
final

Longest input in tokens, prefix and terminators included, that the loaded engine can accept. Include configured context and single-pass batch limits; null when no effective limit is known.

Implementation

final int? maxInputTokens;