CactusVLM class
Methods
-
applyLoraAdapters(List<LoraAdapterInfo> adapters)
→ Future<void>
-
-
completion(List<ChatMessage> messages, {List<String> imagePaths = const [], int maxTokens = 256, double? temperature, int? topK, double? topP, List<String>? stopSequences, CactusTokenCallback? onToken, String mode = "local"})
→ Future<CactusCompletionResult>
-
-
detokenize(List<int> tokens)
→ Future<String>
-
-
dispose()
→ void
-
-
download({required String modelUrl, required String mmprojUrl, String? modelFilename, String? mmprojFilename, CactusProgressCallback? onProgress})
→ Future<bool>
-
-
getLoadedLoraAdapters()
→ Future<List<LoraAdapterInfo>>
-
-
init({String? modelFilename, String? mmprojFilename, String? chatTemplate, int contextSize = 2048, int gpuLayers = 0, int threads = 4, CactusProgressCallback? onProgress, String? cactusToken})
→ Future<bool>
-
-
isLoaded()
→ bool
-
-
noSuchMethod(Invocation invocation)
→ dynamic
-
Invoked when a nonexistent method or property is accessed.
inherited
-
removeLoraAdapters()
→ Future<void>
-
-
rewind()
→ Future<void>
-
-
stopCompletion()
→ Future<void>
-
-
tokenize(String text)
→ Future<List<int>>
-
-
toString()
→ String
-
A string representation of this object.
inherited
-
unload()
→ void
-