LLamaSamplerParams class

General Library Documentation Undocument By General Corporation & Global Corporation & General Developer

Constructors

LLamaSamplerParams()
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
LLamaSamplerParams.fromJson(Map<String, dynamic> json)
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer

Properties

dryAllowedLen ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
dryBreakers ↔ List<String>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
dryLookback ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
dryMultiplier ↔ double
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
dryPenalty ↔ double
@details DRY sampler, designed by p-e-w, described in: https://github.com/oobabooga/text-generation-webui/pull/5677
getter/setter pair
grammarRoot ↔ String
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
grammarStr ↔ String
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
greedy ↔ bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
hashCode → int
The hash code for this object.
no setterinherited
ignoreEOS ↔ bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
minP ↔ double
@details Minimum P sampling as described in https://github.com/ggerganov/llama.cpp/pull/3841
getter/setter pair
minPKeep ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
mirostat2Eta ↔ double
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
mirostat2Tau ↔ double
@details Mirostat 2.0 algorithm described in the paper https://arxiv.org/abs/2007.14966
getter/setter pair
mirostatEta ↔ double
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
mirostatM ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
mirostatTau ↔ double
@details Mirostat 1.0 algorithm described in the paper https://arxiv.org/abs/2007.14966. Uses tokens instead of words. @param tau The target cross-entropy (or surprise) value you want to achieve for the generated text @param eta The learning rate used to update mu based on the error between target and observed surprisal @param m The number of tokens considered in the estimation of s_hat
getter/setter pair
penaltyFreq ↔ double
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
penaltyLastTokens ↔ int
@details Token penalties configuration
getter/setter pair
penaltyNewline ↔ bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
penaltyPresent ↔ double
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
penaltyRepeat ↔ double
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
runtimeType → Type
A representation of the runtime type of the object.
no setterinherited
seed ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
softmax ↔ bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
temp ↔ double
@details Updates the logits l_i` = l_i/t. When t <= 0.0f, the maximum logit is kept at it's original value, the rest are set to -inf
getter/setter pair
topK ↔ int
@details Top-K sampling described in academic paper "The Curious Case of Neural Text Degeneration" https://arxiv.org/abs/1904.09751
getter/setter pair
topP ↔ double
@details Nucleus sampling described in academic paper "The Curious Case of Neural Text Degeneration" https://arxiv.org/abs/1904.09751
getter/setter pair
topPKeep ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
typical ↔ double
@details Locally Typical Sampling implementation described in the paper https://arxiv.org/abs/2202.00666
getter/setter pair
typicalKeep ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
xtcKeep ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
xtcLength ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
xtcStartValue ↔ double
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
xtcTemperature ↔ double
@details XTC sampler as described in https://github.com/oobabooga/text-generation-webui/pull/6335
getter/setter pair

Methods

noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
toJson() → Map<String, dynamic>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
toString() → String
A string representation of this object.
inherited

Operators

operator ==(Object other) → bool
The equality operator.
inherited