llama_context_params class final

General Library Documentation Undocument By General Corporation & Global Corporation & General Developer

Inheritance
Implemented types
Available extensions

Constructors

llama_context_params()

Properties

abort_callback ↔ ggml_abort_callback
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
abort_callback_data ↔ Pointer<Void>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
address → Pointer<T>

Available on T, provided by the StructAddress extension

The memory address of the underlying data.
no setter
attention_type ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
cb_eval ↔ ggml_backend_sched_eval_callback
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
cb_eval_user_data ↔ Pointer<Void>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
defrag_thold ↔ double
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
embeddings ↔ bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
flash_attn ↔ bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
hashCode → int
The hash code for this object.
no setterinherited
logits_all ↔ bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
n_batch ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
n_ctx ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
n_seq_max ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
n_threads ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
n_threads_batch ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
n_ubatch ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
no_perf ↔ bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
offload_kqv ↔ bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
pooling_type ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
rope_freq_base ↔ double
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
rope_freq_scale ↔ double
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
rope_scaling_type ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
runtimeType → Type
A representation of the runtime type of the object.
no setterinherited
type_k ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
type_v ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
yarn_attn_factor ↔ double
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
yarn_beta_fast ↔ double
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
yarn_beta_slow ↔ double
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
yarn_ext_factor ↔ double
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair
yarn_orig_ctx ↔ int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
getter/setter pair

Methods

noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
toString() → String
A string representation of this object.
inherited

Operators

operator ==(Object other) → bool
The equality operator.
inherited