LlmInterface class abstract interface

Implementers

Properties

hashCode → int
The hash code for this object.
no setterinherited
isGenerating → bool
Whether generation is currently in progress.
no setter
isInitialized → bool
Whether the model is loaded and ready for generation.
no setter
runtimeType → Type
A representation of the runtime type of the object.
no setterinherited

Methods

clean() → void
dispose() → void
loadModel(String localPath) → Future<void>
noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
sendPrompt(String prompt, {List<LlamaImageContent>? images}) → Stream<String>
Sends a prompt and returns a stream of tokens.
sendPromptComplete(String prompt, {List<LlamaImageContent>? images}) → Future<String>
Sends a prompt and waits for the complete response.
sendPromptStream(String prompt, {List<LlamaImageContent>? images}) → Stream<StreamingChunk>
Sends a prompt and returns a stream of StreamingChunk with live performance metrics. Recommended method for UI use.
toString() → String
A string representation of this object.
inherited

Operators

operator ==(Object other) → bool
The equality operator.
inherited