dart_bert_tokenizer 1.0.2 copy "dart_bert_tokenizer: ^1.0.2" to clipboard
dart_bert_tokenizer: ^1.0.2 copied to clipboard

A lightweight, pure Dart implementation of BERT WordPiece tokenizer. 100% compatible with HuggingFace tokenizers.

3 versionsVersions feed

Stable versions of dart_bert_tokenizer

VersionMin Dart SDKUploadedDocumentationArchive
1.0.23.102 days agoGo to the documentation of dart_bert_tokenizer 1.0.2Download dart_bert_tokenizer 1.0.2 archive
1.0.13.102 days agoGo to the documentation of dart_bert_tokenizer 1.0.1Download dart_bert_tokenizer 1.0.1 archive
1.0.03.103 days agoDownload dart_bert_tokenizer 1.0.0 archive
1
likes
150
points
78
downloads

Publisher

verified publisherbrodykim.work

Weekly Downloads

A lightweight, pure Dart implementation of BERT WordPiece tokenizer. 100% compatible with HuggingFace tokenizers.

Repository (GitHub)
View/report issues

Topics

#nlp #bert #tokenizer #machine-learning #wordpiece

Documentation

API reference

License

MIT (license)

More

Packages that depend on dart_bert_tokenizer