llama_cpp 1.2.0 copy "llama_cpp: ^1.2.0" to clipboard
llama_cpp: ^1.2.0 copied to clipboard

A dart binding for llama.cpp library, bringing AI to dart world.

1.2.0 #

  • upgrade native_assets_cli to 0.8.0
  • upgrade llama.cpp to 8854044

1.1.0 #

  • Upgrade llama.cpp to 60ed04cf to support qwen1.5.
  • Code refine.
  • Support embedding.
  • Support GPU building.
  • Add a RAG example.
  • Upgrade llama.cpp to 8c0e8f4e.

1.0.0 #

  • Upgrade Dart to 3.3.0.
  • Upgrade dependencies and fix issues.

0.9.0 #

  • Initial version.
  • Integrate with native_assets_cli.
  • Native helper classes.
  • Porting token sampling from common/sampling.cpp.
  • Passing LLM params to the isolate.
  • Token string as raw bytes stream.
13
likes
150
points
200
downloads

Publisher

unverified uploader

Weekly Downloads

2024.09.16 - 2025.03.31

A dart binding for llama.cpp library, bringing AI to dart world.

Repository (GitHub)

Topics

#ai #nlp #llm

Documentation

API reference

License

Apache-2.0 (license)

Dependencies

ffi, native_assets_cli

More

Packages that depend on llama_cpp