InferenceModel class abstract
Represents an LLM model instance.
- Implementers
Constructors
Properties
- chat ↔ InferenceChat?
-
getter/setter pair
- fileType → ModelFileType
-
no setter
- hashCode → int
-
The hash code for this object.
no setterinherited
- maxTokens → int
-
no setter
- runtimeType → Type
-
A representation of the runtime type of the object.
no setterinherited
- session → InferenceModelSession?
-
no setter
Methods
-
close(
) → Future< void> -
createChat(
{double temperature = .8, int randomSeed = 1, int topK = 1, double? topP, int tokenBuffer = 256, String? loraPath, bool? supportImage, List< Tool> tools = const [], bool? supportsFunctionCalls, bool isThinking = false, ModelType? modelType}) → Future<InferenceChat> -
createSession(
{double temperature = .8, int randomSeed = 1, int topK = 1, double? topP, String? loraPath, bool? enableVisionModality}) → Future< InferenceModelSession> - Creates a new InferenceModelSession for generation.
-
noSuchMethod(
Invocation invocation) → dynamic -
Invoked when a nonexistent method or property is accessed.
inherited
-
toString(
) → String -
A string representation of this object.
inherited
Operators
-
operator ==(
Object other) → bool -
The equality operator.
inherited