io/models/context_params library
Classes
- LLamaContextParams
- ContextParams holds configuration settings for the Llama model context
Enums
- LlamaAttentionType
- Attention types for embeddings
- LlamaPoolingType
- Pooling types for embeddings
- LlamaRopeScalingType
- RoPE scaling types