InferenceModel class abstract

Represents an LLM model instance.

Implementers

Constructors

InferenceModel.new()

Properties

chat InferenceChat?
getter/setter pair
hashCode int
The hash code for this object.
no setterinherited
maxTokens int
no setter
runtimeType Type
A representation of the runtime type of the object.
no setterinherited
session InferenceModelSession?
no setter

Methods

close() Future<void>
createChat({double temperature = .8, int randomSeed = 1, int topK = 1, double? topP, int tokenBuffer = 256, String? loraPath, bool? supportImage}) Future<InferenceChat>
Creates a chat interface wrapping InferenceChat.
createSession({double temperature = .8, int randomSeed = 1, int topK = 1, double? topP, String? loraPath, bool? enableVisionModality}) Future<InferenceModelSession>
Creates a new InferenceModelSession for generation.
noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
toString() String
A string representation of this object.
inherited

Operators

operator ==(Object other) bool
The equality operator.
inherited