local_ai_llama_cpp 0.0.3 copy "local_ai_llama_cpp: ^0.0.3" to clipboard
local_ai_llama_cpp: ^0.0.3 copied to clipboard

llama.cpp adapter for LocalAI Kit: runs any GGUF model as a LocalLlm (streaming, GBNF-constrained structured output) and as a LocalEmbedding, with all FFI work isolated in worker isolates.

1 versionVersions feed

Stable versions of local_ai_llama_cpp

VersionMin Dart SDKUploadedDocumentationArchive
0.0.33.611 days agoGo to the documentation of local_ai_llama_cpp 0.0.3Download local_ai_llama_cpp 0.0.3 archive
0
likes
140
points
61
downloads

Documentation

API reference

Publisher

unverified uploader

Weekly Downloads

llama.cpp adapter for LocalAI Kit: runs any GGUF model as a LocalLlm (streaming, GBNF-constrained structured output) and as a LocalEmbedding, with all FFI work isolated in worker isolates.

Repository (GitHub)
View/report issues

License

Apache-2.0 (license)

Dependencies

flutter, llama_cpp_dart, local_ai_core

More

Packages that depend on local_ai_llama_cpp