CactusLM class

Constructors

CactusLM()

factory

Properties

hashCode → int

The hash code for this object.

no setter, inherited

runtimeType → Type

A representation of the runtime type of the object.

no setter, inherited

Methods

applyLoraAdapters(List<LoraAdapterInfo> adapters) → Future<void>

completion(List<ChatMessage> messages, {int maxTokens = 256, double? temperature, int? topK, double? topP, List<String>? stopSequences, CactusTokenCallback? onToken}) → Future<CactusCompletionResult>

detokenize(List<int> tokens) → Future<String>

dispose() → void

download({required String modelUrl, String? modelFilename, CactusProgressCallback? onProgress}) → Future<bool>

embedding(String text, {String mode = "local"}) → Future<List<double>>

getLoadedLoraAdapters() → Future<List<LoraAdapterInfo>>

init({String? modelFilename, String? chatTemplate, int contextSize = 2048, int gpuLayers = 0, int threads = 4, bool generateEmbeddings = false, CactusProgressCallback? onProgress, String? cactusToken}) → Future<bool>

isLoaded() → bool

noSuchMethod(Invocation invocation) → dynamic

Invoked when a nonexistent method or property is accessed.

inherited

removeLoraAdapters() → Future<void>

rewind() → Future<void>

stopCompletion() → Future<void>

tokenize(String text) → Future<List<int>>

toString() → String

A string representation of this object.

inherited

unload() → void

Operators

operator ==(Object other) → bool

The equality operator.

inherited

Static Methods

initLegacy({required String modelUrl, String? modelFilename, String? chatTemplate, int contextSize = 2048, int gpuLayers = 0, int threads = 4, bool generateEmbeddings = false, CactusProgressCallback? onProgress, String? cactusToken}) → Future<CactusLM>