load method
Builds the tokenizer (tokenizerFactory(tokenizerPath)), calls
openGraph, and reports text, the graph's dimension and its
maxInputTokens.
Implementation
@override
@nonVirtual
Future<EmbeddingPassInfo> load() async {
_tokenizer = await _tokenizerFactory(_tokenizerPath);
_graphOpening = true;
final graph = await openGraph();
_graph = graph;
return EmbeddingPassInfo(
dimension: graph.dimension,
modalities: const {EmbeddingModality.text},
maxInputTokens: graph.maxInputTokens,
);
}