llama_ftype class abstract
model file types
Constructors
Properties
- hashCode → int
-
The hash code for this object.
no setterinherited
- runtimeType → Type
-
A representation of the runtime type of the object.
no setterinherited
Methods
-
noSuchMethod(
Invocation invocation) → dynamic -
Invoked when a nonexistent method or property is accessed.
inherited
-
toString(
) → String -
A string representation of this object.
inherited
Operators
-
operator ==(
Object other) → bool -
The equality operator.
inherited
Constants
- LLAMA_FTYPE_ALL_F32 → const int
- LLAMA_FTYPE_GUESSED → const int
- not specified in the model file
- LLAMA_FTYPE_MOSTLY_F16 → const int
- except 1d tensors
- LLAMA_FTYPE_MOSTLY_IQ2_XS → const int
- except 1d tensors
- LLAMA_FTYPE_MOSTLY_IQ2_XXS → const int
- except 1d tensors
- LLAMA_FTYPE_MOSTLY_IQ3_XXS → const int
- except 1d tensors
- LLAMA_FTYPE_MOSTLY_Q2_K → const int
- except 1d tensors
- LLAMA_FTYPE_MOSTLY_Q2_K_S → const int
- except 1d tensors
- LLAMA_FTYPE_MOSTLY_Q3_K_L → const int
- except 1d tensors
- LLAMA_FTYPE_MOSTLY_Q3_K_M → const int
- except 1d tensors
- LLAMA_FTYPE_MOSTLY_Q3_K_S → const int
- except 1d tensors
- LLAMA_FTYPE_MOSTLY_Q3_K_XS → const int
- except 1d tensors
- LLAMA_FTYPE_MOSTLY_Q4_0 → const int
- except 1d tensors
- LLAMA_FTYPE_MOSTLY_Q4_1 → const int
- except 1d tensors
- LLAMA_FTYPE_MOSTLY_Q4_1_SOME_F16 → const int
- tok_embeddings.weight and output.weight are F16
- LLAMA_FTYPE_MOSTLY_Q4_K_M → const int
- except 1d tensors
- LLAMA_FTYPE_MOSTLY_Q4_K_S → const int
- except 1d tensors
- LLAMA_FTYPE_MOSTLY_Q5_0 → const int
- except 1d tensors
- LLAMA_FTYPE_MOSTLY_Q5_1 → const int
- except 1d tensors
- LLAMA_FTYPE_MOSTLY_Q5_K_M → const int
- except 1d tensors
- LLAMA_FTYPE_MOSTLY_Q5_K_S → const int
- except 1d tensors
- LLAMA_FTYPE_MOSTLY_Q6_K → const int
- except 1d tensors
- LLAMA_FTYPE_MOSTLY_Q8_0 → const int
- except 1d tensors