load method

Builds the tokenizer (tokenizerFactory(tokenizerPath)), calls openGraph, and reports text, the graph's dimension and its maxInputTokens.

Implementation

@override
@nonVirtual
Future<EmbeddingPassInfo> load() async {
  _tokenizer = await _tokenizerFactory(_tokenizerPath);
  _graphOpening = true;
  final graph = await openGraph();
  _graph = graph;
  return EmbeddingPassInfo(
    dimension: graph.dimension,
    modalities: const {EmbeddingModality.text},
    maxInputTokens: graph.maxInputTokens,
  );
}