llama_cpp 1.1.0 copy "llama_cpp: ^1.1.0" to clipboard
llama_cpp: ^1.1.0 copied to clipboard

A dart binding for llama.cpp library, bringing AI to dart world.

1.1.0 #

  • Upgrade llama.cpp to 60ed04cf to support qwen1.5.
  • Code refine.
  • Support embedding.
  • Support GPU building.
  • Add a RAG example.
  • Upgrade llama.cpp to 8c0e8f4e.

1.0.0 #

  • Upgrade Dart to 3.3.0.
  • Upgrade dependencies and fix issues.

0.9.0 #

  • Initial version.
  • Integrate with native_assets_cli.
  • Native helper classes.
  • Porting token sampling from common/sampling.cpp.
  • Passing LLM params to the isolate.
  • Token string as raw bytes stream.
13
likes
150
points
190
downloads

Publisher

unverified uploader

Weekly Downloads

2024.09.21 - 2025.04.05

A dart binding for llama.cpp library, bringing AI to dart world.

Repository (GitHub)
View/report issues

Topics

#ai #nlp #llm

Documentation

API reference

License

Apache-2.0 (license)

Dependencies

ffi, native_assets_cli, native_toolchain_c

More

Packages that depend on llama_cpp