runanywhere_llamacpp 0.20.24

LlamaCpp backend for RunAnywhere Flutter SDK. High-performance on-device LLM text generation with GGUF model support.

runanywhere_llamacpp

Llama.cpp LLM backend for the RunAnywhere Flutter SDK — GGUF text generation on iOS and Android.

---

Installation

dependencies:
  runanywhere: 0.20.24
  runanywhere_llamacpp: 0.20.24

Platform setup (Podfile, permissions) is documented in the Flutter SDK README.

---

Usage

import 'package:runanywhere/runanywhere.dart';
import 'package:runanywhere_llamacpp/runanywhere_llamacpp.dart';

await RunAnywhere.initialize();
await LlamaCpp.register();

// Register, download, load models and generate via core RunAnywhere APIs
final result = await RunAnywhere.llm.generate(
  'Hello!',
  LLMGenerationOptions(maxTokens: 64),
);

See the Flutter SDK README for full examples.

---

Support

• Flutter SDK documentation
• Discord
• [e-mail]

---

License

RunAnywhere License. See LICENSE.