FllamaPlatform class abstract

Inheritance
  • Object
  • PlatformInterface
  • FllamaPlatform
Implementers

Constructors

FllamaPlatform()
Constructs a FllamaPlatform.

Properties

hashCode int
The hash code for this object.
no setterinherited
onTokenStream Stream<Map<Object?, dynamic>>?
no setter
runtimeType Type
A representation of the runtime type of the object.
no setterinherited

Methods

bench(double contextId, {required double pp, required double tg, required double pl, required double nr}) Future<String?>
completion(double contextId, {required String prompt, List<List<double>>? logitBias, String grammar = "", double temperature = 0.7, int nThreads = 0, int nPredict = -1, int nProbs = 0, int penaltyLastN = 64, double penaltyRepeat = 1.0, double penaltyFreq = 0.0, double penaltyPresent = 0.0, double mirostat = 0.0, double mirostatTau = 5.0, double mirostatEta = 0.1, bool penalizeNl = false, int topK = 40, double topP = 0.95, double minP = 0.05, double typicalP = 1.0, double xtcThreshold = 0.0, double xtcProbability = 0.0, int seed = -1, List<String>? stop, bool ignoreEos = false, bool emitRealtimeCompletion = false}) Future<Map<Object?, dynamic>?>
detokenize(double contextId, {required List<int> tokens}) Future<String?>
getCpuInfo() Future<Map<Object?, dynamic>?>
getFileSHA256(String filePath) Future<String?>
getFormattedChat(double contextId, {required List<RoleContent> messages, String? chatTemplate}) Future<String?>
initContext(String model, {bool embedding = false, int nCtx = 768, int nBatch = 768, int nThreads = 0, int nGpuLayers = 0, bool useMlock = true, bool useMmap = true, String lora = "", bool loraInitWithoutApply = false, double loraScaled = 1.0, double ropeFreqBase = 0.0, double ropeFreqScale = 0.0, bool emitLoadProgress = false}) Future<Map<Object?, dynamic>?>
loadSession(double contextId, {required String path}) Future<Map<Object?, dynamic>?>
noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
releaseAllContexts() Future<void>
releaseContext(double contextId) Future<void>
saveSession(double contextId, {required String path, required double size}) Future<int?>
stopCompletion(double contextId) Future<void>
tokenize(double contextId, {required String text}) Future<Map<Object?, dynamic>?>
toString() String
A string representation of this object.
inherited

Operators

operator ==(Object other) bool
The equality operator.
inherited

Static Properties

instance FllamaPlatform
The default instance of FllamaPlatform to use.
getter/setter pair