llm_vllm 0.3.0 
llm_vllm: ^0.3.0 copied to clipboard
VLLM backend implementation for LLM interactions. Provides streaming chat, embeddings, tool calling, vision support, and model management.
0
likes
-/ -
pub points
453
downloads
This package version is not analyzed. Check the latest stable version for its analysis.
Check the analysis log for details.
Weekly downloads
Metadata
0
likes
0
points
453
downloads
Publisher
unverified uploader
Weekly Downloads
Metadata
VLLM backend implementation for LLM interactions. Provides streaming chat, embeddings, tool calling, vision support, and model management.
Repository (GitHub)
View/report issues
Topics
#vllm #llm #ai #chat #embeddings
License
unknown (license)