flutter_edge_ai_embeddings 2.2.1

Embedding tokenizers for flutter_edge_ai: Gemma SentencePiece and BERT WordPiece, as a registrable provider. The pipeline they feed lives in flutter_edge_ai.

example/README.md

flutter_edge_ai_embeddings example

flutter_edge_ai_embeddings is the runtime-agnostic on-device text-embedding pipeline for flutter_edge_ai — tokenization, the background-isolate worker, and pooling/normalization, over an EmbeddingForwardPass seam. It does not ship a concrete backend itself (since 2.0.0); pair it with an engine package that provides one, e.g. flutter_edge_ai_litertlm's LiteRtEmbeddingBackend (Gecko / EmbeddingGemma .tflite via the LiteRT C API — dart:ffi on the 5 native platforms, LiteRT.js on web). Register the backend once at startup, then embed text and feed the vectors into any RAG vector store.

import 'package:flutter/widgets.dart';
import 'package:flutter_edge_ai/flutter_edge_ai.dart';
import 'package:flutter_edge_ai_embeddings/flutter_edge_ai_embeddings.dart';
import 'package:flutter_edge_ai_litertlm/flutter_edge_ai_litertlm.dart';

Future<void> main() async {
  WidgetsFlutterBinding.ensureInitialized();

  // The backend comes from an engine package; the tokenizers from this one.
  await FlutterEdgeAi.initialize(
    embeddingBackends: [LiteRtEmbeddingBackend()],   // flutter_edge_ai_litertlm
    embeddingTokenizers: [GemmaEmbeddingTokenizers()],
  );

  // Install an embedding model (downloads + sets it active). The model and its
  // tokenizer are separate downloads.
  await FlutterEdgeAi.installEmbedder()
      .modelFromNetwork('https://example.com/embeddinggemma.tflite', token: 'hf_...')
      .tokenizerFromNetwork('https://example.com/sentencepiece.model', token: 'hf_...')
      .install();

  // Create the embedding model and embed text.
  final embedder = await FlutterEdgeAi.getActiveEmbedder();
  final vector = await embedder.generateEmbedding('Gemma runs on-device.');
  print('embedding dim: ${vector.length}');

  await embedder.close();
}

Pair this with a RAG vector store (flutter_edge_ai_qdrant on native, flutter_edge_ai_sqlite for web) to build on-device retrieval. A full runnable app lives in the flutter_edge_ai example.