llm_vllm 0.4.0 
llm_vllm: ^0.4.0 copied to clipboard
VLLM backend implementation for LLM interactions. Provides streaming chat, embeddings, tool calling, vision support, and model management.
4 versions
Stable versions of llm_vllm
| Version | Min Dart SDK | Uploaded | Documentation | Archive | |
|---|---|---|---|---|---|
| 0.4.0 | 3.12 | 8 days ago |  |  | |
| 0.3.2 | 3.12 | 21 days ago | | | |
| 0.3.1 | 3.12 | 21 days ago | | ||
| 0.3.0 | 3.8 | 22 days ago | |
Metadata
0
likes
160
points
453
downloads
Documentation
Publisher
unverified uploader
Weekly Downloads
Metadata
VLLM backend implementation for LLM interactions. Provides streaming chat, embeddings, tool calling, vision support, and model management.
Repository (GitHub)
View/report issues
Contributing
Topics
#vllm #llm #ai #chat #embeddings
License
MIT (license)