Skip to main content

llm_toolkit 0.1.0 copy "llm_toolkit: ^0.1.0" to clipboard
llm_toolkit: ^0.1.0 copied to clipboard

On-device AI toolkit for Flutter: LLM chat (GGUF via llama.cpp, LiteRT-LM), vision, Whisper speech recognition, embeddings and RAG, Hugging Face/Ollama model discovery and resumable downloads, structu [...]

Use this package as a library

Depend on it

Run this command:

With Flutter:

 $ flutter pub add llm_toolkit

This will add a line like this to your package's pubspec.yaml (and run an implicit flutter pub get):

dependencies:
  llm_toolkit: ^0.1.0

Alternatively, your editor might support flutter pub get. Check the docs for your editor to learn more.

Import it

Now in your Dart code, you can use:

import 'package:llm_toolkit/llm_toolkit.dart';
10
likes
150
points
118
downloads

Documentation

API reference

Publisher

unverified uploader

Weekly Downloads

On-device AI toolkit for Flutter: LLM chat (GGUF via llama.cpp, LiteRT-LM), vision, Whisper speech recognition, embeddings and RAG, Hugging Face/Ollama model discovery and resumable downloads, structured output and tool calling.

Repository (GitHub)
View/report issues

Topics

#llm #on-device-ai #speech-recognition #rag #llama-cpp

License

MIT (license)

Dependencies

collection, crypto, dio, fftea, flutter, flutter_edge_ai, flutter_edge_ai_litertlm, http, llama_cpp_dart, path, path_provider, record, sherpa_onnx, tflite_flutter

More

Packages that depend on llm_toolkit