ContextParams class
Constructors
- ContextParams()
-
ContextParams.fromJson(Map<
String, dynamic> json) -
factory
Properties
- attentionType ↔ LlamaAttentionType
-
getter/setter pair
- defragThold ↔ double
-
getter/setter pair
- embeddings ↔ bool
-
getter/setter pair
- flashAttention ↔ LlamaFlashAttnType
-
getter/setter pair
- hashCode → int
-
The hash code for this object.
no setterinherited
- kvUnified ↔ bool
-
getter/setter pair
- nBatch ↔ int
-
getter/setter pair
- nCtx ↔ int
-
getter/setter pair
- noPerfTimings ↔ bool
-
getter/setter pair
- nPredict ↔ int
-
Generation Config (App level)
getter/setter pair
- nSeqMax ↔ int
-
getter/setter pair
- nThreads ↔ int
-
getter/setter pair
- nThreadsBatch ↔ int
-
getter/setter pair
- nUbatch ↔ int
-
getter/setter pair
- offloadKqv ↔ bool
-
getter/setter pair
- opOffload ↔ bool
-
getter/setter pair
- poolingType ↔ LlamaPoolingType
-
getter/setter pair
- ropeFreqBase ↔ double
-
getter/setter pair
- ropeFreqScale ↔ double
-
getter/setter pair
- ropeScalingType ↔ LlamaRopeScalingType
-
getter/setter pair
- runtimeType → Type
-
A representation of the runtime type of the object.
no setterinherited
- swaFull ↔ bool
-
getter/setter pair
- typeK ↔ LlamaKvCacheType
-
getter/setter pair
- typeV ↔ LlamaKvCacheType
-
getter/setter pair
- yarnAttnFactor ↔ double
-
getter/setter pair
- yarnBetaFast ↔ double
-
getter/setter pair
- yarnBetaSlow ↔ double
-
getter/setter pair
- yarnExtFactor ↔ double
-
getter/setter pair
- yarnOrigCtx ↔ int
-
getter/setter pair
Methods
-
get(
) → llama_context_params -
noSuchMethod(
Invocation invocation) → dynamic -
Invoked when a nonexistent method or property is accessed.
inherited
-
toJson(
) → Map< String, dynamic> -
toString(
) → String -
A string representation of this object.
override
Operators
-
operator ==(
Object other) → bool -
The equality operator.
inherited