dart_bert_tokenizer 1.1.0 
dart_bert_tokenizer: ^1.1.0 copied to clipboard
brodykim.workA pure Dart BERT WordPiece tokenizer with Hugging Face tokenizer.json loading, Unicode offsets, padding, truncation, and verified model fixtures.
2
likes
-/ -
pub points
725
downloads
This package version is not analyzed. Check the latest stable version for its analysis.
Check the analysis log for details.
Weekly downloads
Metadata
2
likes
0
points
725
downloads
Publisher
Weekly Downloads
Metadata
A pure Dart BERT WordPiece tokenizer with Hugging Face tokenizer.json loading, Unicode offsets, padding, truncation, and verified model fixtures.
Repository (GitHub)
View/report issues
Topics
#nlp #bert #tokenizer #machine-learning #wordpiece
License
unknown (license)