Tokenizer.fromFile constructor

Tokenizer.fromFile(
  1. String path
)

Loads a tokenizer from a tokenizer.json file on disk.

Implementation

factory Tokenizer.fromFile(String path) =>
    Tokenizer.fromBytes(File(path).readAsBytesSync());