llama_context_params class final
- Inheritance
- Implemented types
- Available extensions
Constructors
Properties
- abort_callback ↔ ggml_abort_callback
-
getter/setter pair
-
abort_callback_data
↔ Pointer<
Void> -
getter/setter pair
-
address
→ Pointer<
T> -
Available on T, provided by the StructAddress extension
The memory address of the underlying data.no setter - attention_type → llama_attention_type
-
no setter
- attention_typeAsInt ↔ int
-
getter/setter pair
- cb_eval ↔ ggml_backend_sched_eval_callback
-
getter/setter pair
-
cb_eval_user_data
↔ Pointer<
Void> -
getter/setter pair
- defrag_thold ↔ double
-
getter/setter pair
- embeddings ↔ bool
-
getter/setter pair
- flash_attn ↔ bool
-
getter/setter pair
- hashCode → int
-
The hash code for this object.
no setterinherited
- logits_all ↔ bool
-
getter/setter pair
- n_batch ↔ int
-
getter/setter pair
- n_ctx ↔ int
-
getter/setter pair
- n_seq_max ↔ int
-
getter/setter pair
- n_threads ↔ int
-
getter/setter pair
- n_threads_batch ↔ int
-
getter/setter pair
- n_ubatch ↔ int
-
getter/setter pair
- no_perf ↔ bool
-
getter/setter pair
- offload_kqv ↔ bool
-
getter/setter pair
- pooling_type → llama_pooling_type
-
no setter
- pooling_typeAsInt ↔ int
-
getter/setter pair
- rope_freq_base ↔ double
-
getter/setter pair
- rope_freq_scale ↔ double
-
getter/setter pair
- rope_scaling_type → llama_rope_scaling_type
-
no setter
- rope_scaling_typeAsInt ↔ int
-
getter/setter pair
- runtimeType → Type
-
A representation of the runtime type of the object.
no setterinherited
- type_k → ggml_type
-
no setter
- type_kAsInt ↔ int
-
getter/setter pair
- type_v → ggml_type
-
no setter
- type_vAsInt ↔ int
-
getter/setter pair
- yarn_attn_factor ↔ double
-
getter/setter pair
- yarn_beta_fast ↔ double
-
getter/setter pair
- yarn_beta_slow ↔ double
-
getter/setter pair
- yarn_ext_factor ↔ double
-
getter/setter pair
- yarn_orig_ctx ↔ int
-
getter/setter pair
Methods
-
noSuchMethod(
Invocation invocation) → dynamic -
Invoked when a nonexistent method or property is accessed.
inherited
-
toString(
) → String -
A string representation of this object.
inherited
Operators
-
operator ==(
Object other) → bool -
The equality operator.
inherited