llamacpp_tools 0.1.2 copy "llamacpp_tools: ^0.1.2" to clipboard
llamacpp_tools: ^0.1.2 copied to clipboard

Tools to manage llama.cpp local setup (detecting, downloading or building, running).

Changelog #

0.1.2 #

  • Improved CUDA build (copying runtime libraries).
  • Small improvements in LlamacppDir and the server process.

0.1.1 #

  • Added support for running the llama-server process.

0.1.0 #

  • Inital release with downloading from GitHub and building CUDA-support with docker.
0
likes
150
points
282
downloads

Publisher

verified publisheragilord.com

Weekly Downloads

Tools to manage llama.cpp local setup (detecting, downloading or building, running).

Repository (GitHub)
View/report issues

Topics

#llamacpp #llama-cpp #cli #llm #tool

Documentation

API reference

License

BSD-3-Clause (license)

Dependencies

args, html, http, json_annotation, path, process_visor

More

Packages that depend on llamacpp_tools