gpt_tokenizer 0.1.1
gpt_tokenizer: ^0.1.1 copied to clipboard

Published 10 months ago •

simonwang.devDart 3 compatible

SDKDart Flutter

PlatformAndroid iOS Linux macOS web Windows

→

Metadata

The implementation of BPE algorithm for sentence encode/decode

More...

likes

120/ 160

pub points

275

downloads

We analyzed this package 6 days ago, and awarded it 120 pub points (of a possible 160):

Follow Dart file conventions

20 / 30

0/10 points: Provide a valid `pubspec.yaml`

Failed to verify repository URL.

Please provide a valid repository URL in pubspec.yaml, such that:

repository can be cloned,
a clone of the repository contains a pubspec.yaml, which:,
- contains name: gpt_tokenizer,
- contains a version property, and,
- does not contain a publish_to property.

Repository has multiple matching pubspec.yaml with name: gpt_tokenizer.

5/5 points: Provide a valid `README.md`

5/5 points: Provide a valid `CHANGELOG.md`

10/10 points: Use an OSI-approved license

Detected license: MIT.

Provide documentation

10 / 20

0/10 points: 20% or more of the public API has dartdoc comments

8 out of 86 API elements (9.3 %) have documentation comments.

Providing good documentation for libraries, classes, functions, and other API elements improves code readability and helps developers find and use your API. Document at least 20% of the public API elements.

To highlight public API members missing documentation consider enabling the public_member_api_docs lint.

Some symbols that are missing documentation: gpt_tokenizer.BPEWrapper, gpt_tokenizer.BPEWrapper.BPEWrapper, gpt_tokenizer.BPEWrapper.bpe, gpt_tokenizer.BPEWrapper.bridge, gpt_tokenizer.BPEWrapper.countToken.

10/10 points: Package has an example

Platform support

20 / 20

20/20 points: Supports 6 of 6 possible platforms (iOS, Android, Web, Windows, macOS, Linux)

✓ Android
✓ iOS
✓ Windows
✓ Linux
✓ macOS
✓ Web

0/0 points: WASM compatibility

Package not compatible with runtime wasm

Because:

package:gpt_tokenizer/gpt_tokenizer.dart that imports:
package:gpt_tokenizer/src/gen/bridge_generated.dart that imports:
package:gpt_tokenizer/src/gen/bridge_generated.io.dart that imports:
dart:ffi

This package is not compatible with runtime wasm, and will not be rewarded full points in a future version of the scoring model.

See https://dart.dev/web/wasm for details.

Pass static analysis

40 / 50

40/50 points: code has no errors, warnings, lints, or formatting issues

Found 3 issues. Showing the first 2:

/tmp/pana_YJAVRG/lib/src/gen/bridge_generated.dart doesn't match the Dart formatter.

To format your files run: dart format .

/tmp/pana_YJAVRG/lib/src/gen/bridge_generated.io.dart doesn't match the Dart formatter.

To format your files run: dart format .

Support up-to-date dependencies

30 / 40

0/10 points: All of the package dependencies are supported in the latest version

Package	Constraint	Compatible	Latest
`ffi`	`^2.0.1`	2.1.3	2.1.3
`flutter_rust_bridge`	`^1.82.6`	1.82.6	2.7.0
`meta`	`^1.8.0`	1.16.0	1.16.0
`uuid`	`^4.3.3`	4.5.1	4.5.1

Transitive dependencies

Package	Constraint	Compatible	Latest
`archive`	-	3.6.1	4.0.2
`args`	-	2.6.0	2.6.0
`async`	-	2.12.0	2.12.0
`build_cli_annotations`	-	2.1.0	2.1.0
`collection`	-	1.19.1	1.19.1
`convert`	-	3.1.2	3.1.2
`crypto`	-	3.0.6	3.0.6
`fixnum`	-	1.1.1	1.1.1
`http`	-	1.2.2	1.2.2
`http_parser`	-	4.1.1	4.1.1
`js`	-	0.6.7	0.7.1
`logging`	-	1.3.0	1.3.0
`mime`	-	2.0.0	2.0.0
`path`	-	1.9.1	1.9.1
`petitparser`	-	6.0.2	6.0.2
`pool`	-	1.5.1	1.5.1
`puppeteer`	-	3.16.0	3.16.0
`shelf`	-	1.4.2	1.4.2
`shelf_static`	-	1.1.3	1.1.3
`shelf_web_socket`	-	1.0.4	2.0.1
`source_span`	-	1.10.1	1.10.1
`sprintf`	-	7.0.0	7.0.0
`stack_trace`	-	1.12.1	1.12.1
`stream_channel`	-	2.1.3	2.1.3
`string_scanner`	-	1.4.1	1.4.1
`term_glyph`	-	1.2.2	1.2.2
`tuple`	-	2.0.2	2.0.2
`typed_data`	-	1.4.0	1.4.0
`web`	-	0.5.1	1.1.0
`web_socket_channel`	-	2.4.5	3.0.1
`yaml`	-	3.1.3	3.1.3