MobileInferenceModel class

Inheritance

• Object
• InferenceModel
• MobileInferenceModel

Constructors

MobileInferenceModel({required int maxTokens, required VoidCallback onClose, required ModelType modelType, ModelFileType fileType = ModelFileType.task, PreferredBackend? preferredBackend, PreferredBackend? activeBackend, List<int>? supportedLoraRanks, bool supportImage = false, bool supportAudio = false, int? maxNumImages, int? maxConcurrentSessions})

Properties

activeBackend → PreferredBackend?

Backend that the runtime initialized for this model, when known.

final

chat ↔ InferenceChat?

getter/setter pair, inherited

fileType → ModelFileType

final

hashCode → int

The hash code for this object.

no setter, inherited

maxConcurrentSessions → int?

Cap on concurrent openSession sessions; null = unlimited. Wired for when the MediaPipe ProxyApi multi-session path lands; today openSession on the MediaPipe .task path throws UnsupportedError.

final

maxNumImages → int?

final

maxTokens → int

final

modelType → ModelType

final

onClose → VoidCallback

final

preferredBackend → PreferredBackend?

final

runtimeType → Type

A representation of the runtime type of the object.

no setter, inherited

session → InferenceModelSession?

The single session created via createSession. Singleton lane — each createSession call overwrites this field with a new session and closes the previous one.

no setter, override

sessions → List<InferenceModelSession>

Live sessions owned by this model — union of the legacy session (if any) and every active openSession result. Returns an unmodifiable view; mutate via openSession, session.close(), or close.

no setter, override

supportAudio → bool

final

supportedLoraRanks → List<int>?

final

supportImage → bool

final

Methods

close() → Future<void>

override

createChat({double temperature = .8, int randomSeed = 1, int topK = 1, double? topP, int tokenBuffer = 256, String? loraPath, bool? supportImage, bool? supportAudio, List<Tool> tools = const [], bool? supportsFunctionCalls, bool isThinking = false, ModelType? modelType, ToolChoice toolChoice = ToolChoice.auto, int? maxFunctionBufferLength, String? systemInstruction}) → Future<InferenceChat>

override

createSession({double temperature = .8, int randomSeed = 1, int topK = 1, double? topP, String? loraPath, bool? enableVisionModality, bool? enableAudioModality, String? systemInstruction, bool enableThinking = false, List<Tool> tools = const []}) → Future<InferenceModelSession>

Creates a new InferenceModelSession for generation.

override

noSuchMethod(Invocation invocation) → dynamic

Invoked when a nonexistent method or property is accessed.

inherited

openChat({double temperature = .8, int randomSeed = 1, int topK = 1, double? topP, int tokenBuffer = 256, String? loraPath, bool? supportImage, bool? supportAudio, List<Tool> tools = const [], bool? supportsFunctionCalls, bool isThinking = false, ModelType? modelType, ToolChoice toolChoice = ToolChoice.auto, int? maxFunctionBufferLength, String? systemInstruction}) → Future<InferenceChat>

Same as createChat, but uses openSession internally so the resulting chat owns an independent session that does not touch the legacy session field or other open chats. Use this when you need concurrent chats on a single loaded model.

inherited

openSession({double temperature = .8, int randomSeed = 1, int topK = 1, double? topP, String? loraPath, bool? enableVisionModality, bool? enableAudioModality, String? systemInstruction, bool enableThinking = false, List<Tool> tools = const []}) → Future<InferenceModelSession>

Opens a new session detached from session. Each call returns a fresh independent session sharing the loaded model weights but with isolated context (history / KV cache). Use this for concurrent dialogues on a single loaded model.

override

toString() → String

A string representation of this object.

inherited

Operators

operator ==(Object other) → bool

The equality operator.

inherited