LlmInferenceEngine constructor
LlmInferenceEngine(
- LlmInferenceOptions options
Utility to query an LLM with a prompt and receive its response as a stream.
Implementation
LlmInferenceEngine(LlmInferenceOptions options);