llama_cpp_flutter 0.3.0 copy "llama_cpp_flutter: ^0.3.0" to clipboard
llama_cpp_flutter: ^0.3.0 copied to clipboard

On-device LLM inference for Flutter: llama.cpp with Metal on iOS/macOS, wllama on web. Streaming sessions, chat formats, model downloads, and optional agents integration.

example/lib/main.dart

import 'package:flutter/material.dart';
import 'package:llama_cpp_flutter/bridge.dart';

/// Minimal smoke-test app: instantiating [LlamaCppFlutter] registers the plugin
/// and forces the final app link to resolve every llama.cpp symbol the plugin
/// references, which is what CI's macOS job exists to verify. No model is
/// loaded.
void main() {
  runApp(const ExampleApp());
}

class ExampleApp extends StatelessWidget {
  const ExampleApp({super.key});

  @override
  Widget build(BuildContext context) {
    final llama = LlamaCppFlutter();
    return MaterialApp(
      home: Scaffold(
        body: Center(
          child: Text('llama_cpp_flutter linked: ${llama.runtimeType}'),
        ),
      ),
    );
  }
}
0
likes
0
points
121
downloads

Publisher

verified publisherjamiewest.dev

Weekly Downloads

On-device LLM inference for Flutter: llama.cpp with Metal on iOS/macOS, wllama on web. Streaming sessions, chat formats, model downloads, and optional agents integration.

Repository (GitHub)
View/report issues

Topics

#llm #llama-cpp #gguf #on-device-ai #local-ai

License

unknown (license)

Dependencies

agents, extensions, ffi, flutter, meta, web

More

Packages that depend on llama_cpp_flutter

Packages that implement llama_cpp_flutter