llama_model_params class final
- Inheritance
- Implemented types
- Available extensions
Constructors
Properties
- hashCode → int
-
The hash code for this object.
no setterinherited
-
kv_overrides
↔ Pointer<
llama_model_kv_override> -
override key-value pairs of the model meta data
getter/setter pair
- main_gpu ↔ int
-
the GPU that is used for scratch and small tensors
getter/setter pair
- n_gpu_layers ↔ int
-
number of layers to store in VRAM
getter/setter pair
- progress_callback ↔ llama_progress_callback
-
called with a progress value between 0 and 1, pass NULL to disable
getter/setter pair
-
progress_callback_user_data
↔ Pointer<
Void> -
context pointer passed to the progress callback
getter/setter pair
- runtimeType → Type
-
A representation of the runtime type of the object.
no setterinherited
-
tensor_split
↔ Pointer<
Float> -
how to split layers across multiple GPUs (size: LLAMA_MAX_DEVICES)
getter/setter pair
- use_mlock ↔ bool
-
force system to keep model in RAM
getter/setter pair
- use_mmap ↔ bool
-
use mmap if possible
getter/setter pair
- vocab_only ↔ bool
-
only load the vocabulary, no weights
getter/setter pair
Methods
-
noSuchMethod(
Invocation invocation) → dynamic -
Invoked when a nonexistent method or property is accessed.
inherited
-
toString(
) → String -
A string representation of this object.
inherited
Operators
-
operator ==(
Object other) → bool -
The equality operator.
inherited