dart_bert_tokenizer 1.0.2 
dart_bert_tokenizer: ^1.0.2 copied to clipboard
Published 2 days ago • 
brodykim.work
brodykim.workA lightweight, pure Dart implementation of BERT WordPiece tokenizer. 100% compatible with HuggingFace tokenizers.
3 versions
Stable versions of dart_bert_tokenizer
| Version | Min Dart SDK | Uploaded | Documentation | Archive | |
|---|---|---|---|---|---|
| 1.0.2 | 3.10 | 2 days ago |  |  | |
| 1.0.1 | 3.10 | 2 days ago | | | |
| 1.0.0 | 3.10 | 3 days ago | |
Metadata
1
likes
150
points
78
downloads
Publisher
Weekly Downloads
Metadata
A lightweight, pure Dart implementation of BERT WordPiece tokenizer. 100% compatible with HuggingFace tokenizers.
Repository (GitHub)
View/report issues
Topics
#nlp #bert #tokenizer #machine-learning #wordpiece
Documentation
License
MIT (license)
