llamacpp_tools 0.1.0

Tools to manage llama.cpp local setup (detecting, downloading or building).

Dart package and CLI tool for managing llama.cpp local setup (detecting, downloading, building).

Features

• Directory detection: Detect existing llama.cpp installations and get version info
• GitHub integration: Scrape recent versions and download/setup releases from GitHub
• Docker building: Build llama.cpp with CUDA support using containerized environments

Usage

GitHub Operations

# List recent versions from GitHub
dart run llamacpp_tools github scrape-recent-versions

# Download and setup a specific release
dart run llamacpp_tools github setup-release --version 3875 --target ./llama-cpp

Docker Building

# List available builders
dart run llamacpp_tools docker list-builders

# Build a container
dart run llamacpp_tools docker build-builder --builder cuda-builder --container llama-cuda

# Run container to build llama.cpp
dart run llamacpp_tools docker run-builder --container llama-cuda --version 3875 --output ./output