llm_vllm 0.4.0 copy "llm_vllm: ^0.4.0" to clipboard
llm_vllm: ^0.4.0 copied to clipboard

VLLM backend implementation for LLM interactions. Provides streaming chat, embeddings, tool calling, vision support, and model management.

Use this package as a library

Depend on it

Run this command:

With Dart:

 $ dart pub add llm_vllm

With Flutter:

 $ flutter pub add llm_vllm

This will add a line like this to your package's pubspec.yaml (and run an implicit dart pub get):

dependencies:
  llm_vllm: ^0.4.0

Alternatively, your editor might support dart pub get or flutter pub get. Check the docs for your editor to learn more.

Import it

Now in your Dart code, you can use:

import 'package:llm_vllm/llm_vllm.dart';
0
likes
160
points
453
downloads

Documentation

API reference

Publisher

unverified uploader

Weekly Downloads

VLLM backend implementation for LLM interactions. Provides streaming chat, embeddings, tool calling, vision support, and model management.

Repository (GitHub)
View/report issues
Contributing

Topics

#vllm #llm #ai #chat #embeddings

License

MIT (license)

Dependencies

http, llm_core

More

Packages that depend on llm_vllm