MobileInferenceModel class

Inheritance

Constructors

MobileInferenceModel.new({required int maxTokens, required VoidCallback onClose, required MobileModelManager modelManager, required ModelType modelType, PreferredBackend? preferredBackend, List<int>? supportedLoraRanks, bool supportImage = false, int? maxNumImages})

Properties

chat InferenceChat?
getter/setter pairinherited
hashCode int
The hash code for this object.
no setterinherited
maxNumImages int?
final
maxTokens int
final
modelManager MobileModelManager
final
modelType ModelType
final
onClose VoidCallback
final
preferredBackend PreferredBackend?
final
runtimeType Type
A representation of the runtime type of the object.
no setterinherited
session InferenceModelSession?
no setteroverride
supportedLoraRanks List<int>?
final
supportImage bool
final

Methods

close() Future<void>
override
createChat({double temperature = .8, int randomSeed = 1, int topK = 1, double? topP, int tokenBuffer = 256, String? loraPath, bool? supportImage}) Future<InferenceChat>
Creates a chat interface wrapping InferenceChat.
inherited
createSession({double temperature = .8, int randomSeed = 1, int topK = 1, double? topP, String? loraPath, bool? enableVisionModality}) Future<InferenceModelSession>
Creates a new InferenceModelSession for generation.
override
noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
toString() String
A string representation of this object.
inherited

Operators

operator ==(Object other) bool
The equality operator.
inherited