lcpp_sampling_params class final
- Inheritance
- Implemented types
- Available extensions
Constructors
Properties
-
address
→ Pointer<
T> -
Available on T, provided by the StructAddress extension
The memory address of the underlying data.no setter - dry_allowed_length ↔ int
-
tokens extending repetitions beyond this receive penalty
getter/setter pair
- dry_base ↔ double
-
0.0 = disabled; multiplier * base ^ (length of sequence before token - allowed length)
getter/setter pair
- dry_multiplier ↔ double
-
0.0 = disabled; DRY repetition penalty for tokens extending repetition:
getter/setter pair
- dry_penalty_last_n ↔ int
-
how many tokens to scan for repetitions (0 = disable penalty, -1 = context size)
getter/setter pair
- dynatemp_exponent ↔ double
-
controls how entropy maps to temperature in dynamic temperature sampler
getter/setter pair
- dynatemp_range ↔ double
-
0.0 = disabled
getter/setter pair
-
grammar
↔ Pointer<
Char> -
optional BNF-like grammar to constrain sampling
getter/setter pair
- grammar_lazy ↔ bool
-
getter/setter pair
- hashCode → int
-
The hash code for this object.
no setterinherited
- ignore_eos ↔ bool
-
getter/setter pair
- min_keep ↔ int
-
0 = disabled, otherwise samplers should return at least min_keep tokens
getter/setter pair
- min_p ↔ double
-
0.0 = disabled
getter/setter pair
- mirostat → lcpp_mirostat_type
-
no setter
- mirostat_eta ↔ double
-
learning rate
getter/setter pair
- mirostat_tau ↔ double
-
target entropy
getter/setter pair
- mirostatAsInt ↔ int
-
0 = disabled, 1 = mirostat, 2 = mirostat 2.0
getter/setter pair
- n_grammar_length ↔ int
-
getter/setter pair
- n_prev ↔ int
-
number of previous tokens to remember
getter/setter pair
- n_probs ↔ int
-
if greater than 0, output the probabilities of top n_probs tokens.
getter/setter pair
- n_samplers ↔ int
-
getter/setter pair
- no_perf ↔ bool
-
disable performance metrics
getter/setter pair
- penalty_freq ↔ double
-
0.0 = disabled
getter/setter pair
- penalty_last_n ↔ int
-
last n tokens to penalize (0 = disable penalty, -1 = context size)
getter/setter pair
- penalty_present ↔ double
-
0.0 = disabled
getter/setter pair
- penalty_repeat ↔ double
-
1.0 = disabled
getter/setter pair
- runtimeType → Type
-
A representation of the runtime type of the object.
no setterinherited
-
samplers
↔ Pointer<
Uint8> -
getter/setter pair
- seed ↔ int
-
the seed used to initialize llama_sampler
getter/setter pair
- temp ↔ double
-
<= 0.0 to sample greedily, 0.0 to not output probabilities
getter/setter pair
- timing_per_token ↔ bool
-
getter/setter pair
- top_k ↔ int
-
<= 0 to use vocab size
getter/setter pair
- top_n_sigma ↔ double
-
-1.0 = disabled
getter/setter pair
- top_p ↔ double
-
1.0 = disabled
getter/setter pair
- typ_p ↔ double
-
typical_p, 1.0 = disabled
getter/setter pair
- xtc_probability ↔ double
-
0.0 = disabled
getter/setter pair
- xtc_threshold ↔ double
-
0.5 disables XTC
getter/setter pair
Methods
-
noSuchMethod(
Invocation invocation) → dynamic -
Invoked when a nonexistent method or property is accessed.
inherited
-
toString(
) → String -
A string representation of this object.
inherited
Operators
-
operator ==(
Object other) → bool -
The equality operator.
inherited