runanywhere_llamacpp 0.20.18
runanywhere_llamacpp: ^0.20.18 copied to clipboard

Published 9 days ago • Latest: 0.20.24

[unknown platforms]

→

Metadata

LlamaCpp backend for RunAnywhere Flutter SDK. High-performance on-device LLM text generation with GGUF model support.

More...

runanywhere_llamacpp #

Llama.cpp LLM backend for the RunAnywhere Flutter SDK — GGUF text generation on iOS and Android.

Installation #

dependencies:
  runanywhere: 0.20.18
  runanywhere_llamacpp: 0.20.18

Platform setup (Podfile, permissions) is documented in the Flutter SDK README.

Usage #

import 'package:runanywhere/runanywhere.dart';
import 'package:runanywhere_llamacpp/runanywhere_llamacpp.dart';

await RunAnywhere.initialize();
await LlamaCpp.register();

// Register, download, load models and generate via core RunAnywhere APIs
final result = await RunAnywhere.llm.generate(
  'Hello!',
  LLMGenerationOptions(maxTokens: 64),
);

See the Flutter SDK README for full examples.