modelport_llamacpp 0.1.1
modelport_llamacpp: ^0.1.1 copied to clipboard
llama.cpp adapter for ModelPort. Runs GGUF language models from modelport.json bundles with streaming chat.
llama.cpp adapter for ModelPort. Runs GGUF language models from modelport.json bundles with streaming chat.