BpeTokenizer.loadFile constructor

BpeTokenizer.loadFile(
  1. String path
)

Load a tokenizer from a file.

Implementation

factory BpeTokenizer.loadFile(String path) =>
    BpeTokenizer.fromJson(File(path).readAsStringSync());