Local OpenAI-compatible HTTP server for lib_llama_cpp.
More...
lib_llama_cpp
llcs_engine
API reference
gsmlg.dev
Repository (GitHub)View/report issues
MIT (license)
ffi, lib_llama_cpp_ffi
Packages that depend on lib_llama_cpp_server
Back