LlmInferenceEngine constructor

LlmInferenceEngine(
  1. LlmInferenceOptions options
)

Utility to query an LLM with a prompt and receive its response as a stream.

Implementation

LlmInferenceEngine(LlmInferenceOptions options);