EngineHost class
What Engine.create reaches outside Dart, behind one object so a VM test can drive a whole load without a native library or a device.
Constructors
- EngineHost()
-
const
Properties
Methods
-
androidGpuFamily(
) → AndroidGpuFamily? - The GPU family of an Android device; null elsewhere.
-
createClient(
) → LiteRtLmFfiClient - A client for one load.
-
initializeClient(
LiteRtLmFfiClient client, {required String modelPath, required String backend, required int maxTokens, required String? cacheDir, required bool enableVision, required String visionBackend, required int maxNumImages, required bool enableAudio, required String audioBackend, required bool? enableSpeculativeDecoding, required int? speculativeDecodingMode, required int? numThreads, required int? activationDataType, required GpuActivationReason? gpuActivationReason, required NpuDispatch? npuDispatch, required LiteRtLmLogLevel? nativeLogLevel}) → Future< void> -
Creates the engine in
client. -
linearAttentionState(
String path) → Future< bool?> -
Whether the model at
pathkeeps linear attention state; null when the file cannot be read to tell. -
noSuchMethod(
Invocation invocation) → dynamic -
Invoked when a nonexistent method or property is accessed.
inherited
-
npuHost(
NpuPlatform? platform) → LiteRtLmNpuHost -
The NPU answers for
platform. -
toString(
) → String -
A string representation of this object.
inherited
Operators
-
operator ==(
Object other) → bool -
The equality operator.
inherited