llama_cpp_dart 0.0.7 copy "llama_cpp_dart: ^0.0.7" to clipboard
llama_cpp_dart: ^0.0.7 copied to clipboard

Dart binding for llama.cpp --- high level wrappers for both Dart and Flutter

0.0.7 #

  • updated binding
  • performance imporvement and bugs fix

0.0.6 #

  • added initial support to load lora
  • dart cli example
  • fixed #3 by @danemadsen

0.0.5 #

  • removed assets defination
  • added static property Llama.libraryPath to set library path, in order to support linux and other platforms

0.0.4 #

  • ModelParams disabled options splitsMode, tensorSplit and metadataOverride

0.0.3 #

  • LlamaProcessor now take context and model parameters

0.0.2 #

  • refactored code to follow dart package structure

0.0.1 #

  • TODO: Describe initial release.
37
likes
140
pub points
73%
popularity

Publisher

unverified uploader

Dart binding for llama.cpp --- high level wrappers for both Dart and Flutter

Repository (GitHub)
View/report issues

Documentation

API reference

License

MIT (license)

Dependencies

ffi, flutter

More

Packages that depend on llama_cpp_dart