fromPath static method

Load a WordPiece tokenizer from a HuggingFace tokenizer.json at path.

Implementation

static Future<WordPieceEmbeddingTokenizer> fromPath(String path) async {
  final raw = await File(path).readAsString();
  return fromJsonString(raw);
}