litertlm/config library
Classes
- Backend
- Backend for the LiteRT-LM engine.
- Channel
- Definition of a channel for model responses.
- ConversationConfig
- Configuration for a LiteRT-LM conversation.
- CpuBackend
- CPU LiteRT backend.
- EngineConfig
- Configuration for the LiteRT-LM engine.
- GpuBackend
- GPU LiteRT backend.
- LoraConfig
- Configuration for LoRA weights.
- NpuBackend
- NPU LiteRT backend.
- SamplerConfig
- Configuration for the sampling process.
- SessionConfig
- Configuration for a LiteRT-LM session.