modelport_llamacpp 0.1.0 copy "modelport_llamacpp: ^0.1.0" to clipboard
modelport_llamacpp: ^0.1.0 copied to clipboard

llama.cpp adapter for ModelPort. Runs GGUF language models from modelport.json bundles with streaming chat.

Use this package as a library

Depend on it

Run this command:

With Dart:

 $ dart pub add modelport_llamacpp

With Flutter:

 $ flutter pub add modelport_llamacpp

This will add a line like this to your package's pubspec.yaml (and run an implicit dart pub get):

dependencies:
  modelport_llamacpp: ^0.1.0

Alternatively, your editor might support dart pub get or flutter pub get. Check the docs for your editor to learn more.

Import it

Now in your Dart code, you can use:

import 'package:modelport_llamacpp/modelport_llamacpp.dart';
0
likes
160
points
34
downloads

Documentation

Documentation
API reference

Publisher

unverified uploader

Weekly Downloads

llama.cpp adapter for ModelPort. Runs GGUF language models from modelport.json bundles with streaming chat.

Homepage
Repository (GitHub)
View/report issues

Topics

#ai #llm #llama-cpp #gguf #on-device

License

Apache-2.0 (license)

Dependencies

llm_llamacpp, modelport

More

Packages that depend on modelport_llamacpp