betto_icu 0.1.0-dev.1 copy "betto_icu: ^0.1.0-dev.1" to clipboard
betto_icu: ^0.1.0-dev.1 copied to clipboard

Unicode text tokenization for Dart — Tokenizer interface, IcuTokenizer (system ICU FFI, UAX #29), and RegExpTokenizer (pure Dart, Latin fallback).

Use this package as a library

Depend on it

Run this command:

With Dart:

 $ dart pub add betto_icu

With Flutter:

 $ flutter pub add betto_icu

This will add a line like this to your package's pubspec.yaml (and run an implicit dart pub get):

dependencies:
  betto_icu: ^0.1.0-dev.1

Alternatively, your editor might support dart pub get or flutter pub get. Check the docs for your editor to learn more.

Import it

Now in your Dart code, you can use:

import 'package:betto_icu/betto_icu.dart';
0
likes
150
points
81
downloads

Documentation

API reference

Publisher

verified publisherbettongia.com

Weekly Downloads

Unicode text tokenization for Dart — Tokenizer interface, IcuTokenizer (system ICU FFI, UAX #29), and RegExpTokenizer (pure Dart, Latin fallback).

Repository (GitHub)
View/report issues
Contributing

Topics

#text #unicode #nlp #tokenizer #icu

License

unknown (license)

Dependencies

ffi

More

Packages that depend on betto_icu