local_ai_llama_cpp 0.0.3 copy "local_ai_llama_cpp: ^0.0.3" to clipboard
local_ai_llama_cpp: ^0.0.3 copied to clipboard

llama.cpp adapter for LocalAI Kit: runs any GGUF model as a LocalLlm (streaming, GBNF-constrained structured output) and as a LocalEmbedding, with all FFI work isolated in worker isolates.

Use this package as a library

Depend on it

Run this command:

With Flutter:

 $ flutter pub add local_ai_llama_cpp

This will add a line like this to your package's pubspec.yaml (and run an implicit flutter pub get):

dependencies:
  local_ai_llama_cpp: ^0.0.3

Alternatively, your editor might support flutter pub get. Check the docs for your editor to learn more.

Import it

Now in your Dart code, you can use:

import 'package:local_ai_llama_cpp/local_ai_llama_cpp.dart';
0
likes
140
points
61
downloads

Documentation

API reference

Publisher

unverified uploader

Weekly Downloads

llama.cpp adapter for LocalAI Kit: runs any GGUF model as a LocalLlm (streaming, GBNF-constrained structured output) and as a LocalEmbedding, with all FFI work isolated in worker isolates.

Repository (GitHub)
View/report issues

License

Apache-2.0 (license)

Dependencies

flutter, llama_cpp_dart, local_ai_core

More

Packages that depend on local_ai_llama_cpp