DartezTokenizer constructor

DartezTokenizer(Map<String, dynamic> delimiters)

Implementation

DartezTokenizer(this.delimiters) {
  regexGrouping = RegExp(delimiters
      .map<String, String>((key, value) =>
          MapEntry(key, convertValueToRegExpGroupString(value)))
      .values
      .join('|'));
}