juice_llm_llamacpp 0.2.0 copy "juice_llm_llamacpp: ^0.2.0" to clipboard
juice_llm_llamacpp: ^0.2.0 copied to clipboard

Embedded on-device LLM runtime for juice_llm — an LlamaCppProvider backed by llama.cpp (GGUF, Metal) via llama_cpp_dart.

Use this package as a library

Depend on it

Run this command:

With Flutter:

 $ flutter pub add juice_llm_llamacpp

This will add a line like this to your package's pubspec.yaml (and run an implicit flutter pub get):

dependencies:
  juice_llm_llamacpp: ^0.2.0

Alternatively, your editor might support flutter pub get. Check the docs for your editor to learn more.

Import it

Now in your Dart code, you can use:

import 'package:juice_llm_llamacpp/juice_llm_llamacpp.dart';
0
likes
150
points
0
downloads

Documentation

API reference

Publisher

unverified uploader

Weekly Downloads

Embedded on-device LLM runtime for juice_llm — an LlamaCppProvider backed by llama.cpp (GGUF, Metal) via llama_cpp_dart.

Homepage
Repository (GitHub)
View/report issues
Contributing

Topics

#llm #on-device #llama-cpp #ai #juice

Funding

Consider supporting this project:

github.com

License

MIT (license)

Dependencies

flutter, juice_llm, llama_cpp_dart

More

Packages that depend on juice_llm_llamacpp