interface library
Classes
- BaseLlmInferenceEngine
- Utility to query an LLM with a prompt and receive its response as a stream.
- BaseLlmInferenceOptions
- Configuration object for a MediaPipe text classifier.
- BaseLlmResponseContext
- Represents all of or part of an LLM's response to a query.