llm_vllm 0.3.1 copy "llm_vllm: ^0.3.1" to clipboard
llm_vllm: ^0.3.1 copied to clipboard

VLLM backend implementation for LLM interactions. Provides streaming chat, embeddings, tool calling, vision support, and model management.

Use this package as a library

Depend on it

Run this command:

With Dart:

 $ dart pub add llm_vllm

This will add a line like this to your package's pubspec.yaml (and run an implicit dart pub get):

dependencies:
  llm_vllm: ^0.3.1

Alternatively, your editor might support dart pub get. Check the docs for your editor to learn more.

Import it

Now in your Dart code, you can use:

import 'package:llm_vllm/llm_vllm.dart';
0
likes
0
points
453
downloads

Publisher

unverified uploader

Weekly Downloads

VLLM backend implementation for LLM interactions. Provides streaming chat, embeddings, tool calling, vision support, and model management.

Repository (GitHub)
View/report issues

Topics

#vllm #llm #ai #chat #embeddings

License

unknown (license)

Dependencies

http, llm_core

More

Packages that depend on llm_vllm