LlamaCppFlutter class

Entry point for llama.cpp inference.

Create one instance, loadModel one or more GGUF files, then generate against the returned LlamaBridgeSession. Call shutdown when done to tear down the worker isolate.

Constructors

LlamaCppFlutter({LoggerFactory? loggerFactory})

Creates the entry point. loggerFactory supplies loggers for model loading and generation diagnostics; null logs nothing.

Properties

hashCode → int

The hash code for this object.

no setter, inherited

runtimeType → Type

A representation of the runtime type of the object.

no setter, inherited

Methods

loadModel(String path, {int contextSize = 4096, int gpuLayers = 999, String? mmprojPath, int? imageTokenBudget, String? draftModelPath, int draftGpuLayers = 999, int maxDraftTokens = 3, int maxSequences = 1}) → Future<LlamaBridgeSession>

Loads a GGUF model from an absolute filesystem path.

noSuchMethod(Invocation invocation) → dynamic

Invoked when a nonexistent method or property is accessed.

inherited

shutdown() → Future<void>

Tears down the worker isolate. The instance is unusable afterwards.

toString() → String

A string representation of this object.

inherited

Operators

operator ==(Object other) → bool

The equality operator.

inherited