ggufMemoryMetadataKeys function

Set<String> ggufMemoryMetadataKeys(
  1. String architecture
)

GGUF metadata keys the estimator wants for architecture, suitable for readGgufMetadata / readGgufMetadataFile.

Implementation

Set<String> ggufMemoryMetadataKeys(String architecture) => {
  '$architecture.block_count',
  '$architecture.embedding_length',
  '$architecture.attention.head_count',
  '$architecture.attention.head_count_kv',
  '$architecture.attention.key_length',
  '$architecture.attention.value_length',
  '$architecture.context_length',
};