gpt_tokenizer 0.1.1 copy "gpt_tokenizer: ^0.1.1" to clipboard
gpt_tokenizer: ^0.1.1 copied to clipboard

The implementation of BPE algorithm for sentence encode/decode

0
likes
130/ 160
pub points
6%
popularity

We analyzed this package 31 hours ago, and awarded it 130 pub points (of a possible 160):

failed
Follow Dart file conventions
20 / 30trigger folding of the section

0/10 points: Provide a valid pubspec.yaml

Failed to verify repository URL.

Please provide a valid repository URL in pubspec.yaml, such that:

  • repository can be cloned,
  • a clone of the repository contains a pubspec.yaml, which:,
    • contains name: gpt_tokenizer,
    • contains a version property, and,
    • does not contain a publish_to property.

Repository has multiple matching pubspec.yaml with name: gpt_tokenizer.

5/5 points: Provide a valid README.md

5/5 points: Provide a valid CHANGELOG.md

10/10 points: Use an OSI-approved license

Detected license: MIT.

partial
Provide documentation
10 / 20trigger folding of the section

0/10 points: 20% or more of the public API has dartdoc comments

8 out of 86 API elements (9.3 %) have documentation comments.

Providing good documentation for libraries, classes, functions, and other API elements improves code readability and helps developers find and use your API. Document at least 20% of the public API elements.

To highlight public API members missing documentation consider enabling the public_member_api_docs lint.

Some symbols that are missing documentation: gpt_tokenizer.BPEWrapper, gpt_tokenizer.BPEWrapper.BPEWrapper, gpt_tokenizer.BPEWrapper.bpe, gpt_tokenizer.BPEWrapper.bridge, gpt_tokenizer.BPEWrapper.countToken.

10/10 points: Package has an example

OK
Platform support
20 / 20trigger folding of the section

20/20 points: Supports 6 of 6 possible platforms (iOS, Android, Web, Windows, macOS, Linux)

  • ✓ Android
  • ✓ iOS
  • ✓ Windows
  • ✓ Linux
  • ✓ macOS
  • ✓ Web
partial
Pass static analysis
40 / 50trigger folding of the section

40/50 points: code has no errors, warnings, lints, or formatting issues

Found 3 issues. Showing the first 2:

lib/src/gen/bridge_generated.dart doesn't match the Dart formatter.

To format your files run: dart format .

lib/src/gen/bridge_generated.io.dart doesn't match the Dart formatter.

To format your files run: dart format .

OK
Support up-to-date dependencies
40 / 40trigger folding of the section

10/10 points: All of the package dependencies are supported in the latest version

Package Constraint Compatible Latest
ffi ^2.0.1 2.1.2 2.1.2
flutter_rust_bridge ^1.82.6 1.82.6 1.82.6
meta ^1.8.0 1.15.0 1.15.0
uuid ^4.3.3 4.4.0 4.4.0
Transitive dependencies
Package Constraint Compatible Latest
archive - 3.6.1 3.6.1
args - 2.5.0 2.5.0
async - 2.11.0 2.11.0
build_cli_annotations - 2.1.0 2.1.0
collection - 1.18.0 1.18.0
convert - 3.1.1 3.1.1
crypto - 3.0.3 3.0.3
fixnum - 1.1.0 1.1.0
http - 1.2.1 1.2.1
http_parser - 4.0.2 4.0.2
js - 0.6.7 0.7.1
logging - 1.2.0 1.2.0
mime - 1.0.5 1.0.5
path - 1.9.0 1.9.0
petitparser - 6.0.2 6.0.2
pool - 1.5.1 1.5.1
puppeteer - 3.11.0 3.11.0
shelf - 1.4.1 1.4.1
shelf_static - 1.1.2 1.1.2
shelf_web_socket - 1.0.4 2.0.0
source_span - 1.10.0 1.10.0
sprintf - 7.0.0 7.0.0
stack_trace - 1.11.1 1.11.1
stream_channel - 2.1.2 2.1.2
string_scanner - 1.2.0 1.2.0
term_glyph - 1.2.1 1.2.1
tuple - 2.0.2 2.0.2
typed_data - 1.3.2 1.3.2
web - 0.5.1 0.5.1
web_socket_channel - 2.4.5 3.0.0
yaml - 3.1.2 3.1.2

To reproduce run dart pub outdated --no-dev-dependencies --up-to-date --no-dependency-overrides.

10/10 points: Package supports latest stable Dart and Flutter SDKs

20/20 points: Compatible with dependency constraint lower bounds

pub downgrade does not expose any static analysis error.

Analyzed with Pana 0.22.5, Dart 3.4.1.

Check the analysis log for details.

0
likes
130
pub points
6%
popularity

Publisher

verified publishersimonwang.dev

The implementation of BPE algorithm for sentence encode/decode

Repository (GitHub)
View/report issues

Documentation

API reference

License

MIT (LICENSE)

Dependencies

ffi, flutter_rust_bridge, meta, uuid

More

Packages that depend on gpt_tokenizer