llamacpp_tools library
Classes
- LlamacppDir
- Represents a detected llama.cpp directory with its root path.
- LlamaserverConfig
- Configuration for a llama.cpp server process.
- LlamaserverProcess
- Manages a llama.cpp server process lifecycle.
Functions
-
dockerBuildBuilder(
{required String builder, required String containerName}) → Future< void> - Builds a Docker container from a Dockerfile builder.
-
dockerListBuilders(
) → List< String> - Lists available Dockerfile builders that can be used with buildDockerContainer.
-
dockerRunBuilder(
String containerName, String version, String outputDirectory) → Future< void> - Runs a Docker container with specified parameters.
-
scrapeRecentLlamacppVersionsFromGitHub(
) → Future< List< String> > - Visits the llama.cpp GitHub page for recent releases, parses the HTML and returns the versions that may be the most recent ones.
-
setupLllamacppReleaseFromGitHub(
{required String targetPath, required String version}) → Future< LlamacppDir>