native/dart_bridge_llm library
DartBridge+LLM
LLM component bridge - manages C++ LLM component lifecycle. Mirrors Swift's CppBridge+LLM.swift pattern exactly.
This is a thin wrapper around C++ LLM component functions. All business logic is in C++ - Dart only manages the handle.
IMPORTANT: Generation runs in a separate isolate to avoid heap corruption from C++ background threads (Metal GPU operations).
Classes
- DartBridgeLLM
- LLM component bridge for C++ interop.
- LLMComponentResult
- Result from LLM generation.