tokenizers/potion_32m_tokenizer library
Properties
- potion32mTokenizer → WordpieceTokenizer
-
Tokenizer for Potion Retrieval 32M.
final
- fonnx package
- documentation
- tokenizers/potion_32m_tokenizer.dart
fonnx package
- Libraries
- dylib_path_overrides
- extensions/uint8list
- extensions/vector
- fonnx
- models/futo_swipe/futo_swipe
- models/futo_swipe/futo_swipe_native
- models/futo_swipe/futo_swipe_none
- models/futo_swipe/futo_swipe_types
- models/futo_swipe/futo_swipe_web
- models/futo_swipe/src/context_hash
- models/futo_swipe/src/ctc_prefix_search
- models/futo_swipe/src/futo_swipe_engine
- models/futo_swipe/src/futo_swipe_isolate
- models/futo_swipe/src/futo_swipe_ort_backend
- models/futo_swipe/src/trace_resampler
- models/keyword_spotter/keyword_spotter
- models/keyword_spotter/keyword_spotter_native
- models/keyword_spotter/keyword_spotter_none
- models/keyword_spotter/keyword_spotter_types
- models/keyword_spotter/keyword_spotter_web
- models/keyword_spotter/src/context_graph
- models/keyword_spotter/src/english_tokenizer
- models/keyword_spotter/src/english_vocabulary
- models/keyword_spotter/src/keyword_spotter_engine
- models/keyword_spotter/src/keyword_spotter_isolate
- models/keyword_spotter/src/kws_ort_backend
- models/keyword_spotter/src/streaming_fbank
- models/keyword_spotter/src/transducer_decoder
- models/kokoro/kokoro
- models/kokoro/kokoro_chunking
- models/kokoro/kokoro_ffi
- models/kokoro/kokoro_native
- models/kokoro/kokoro_none
- models/kokoro/kokoro_normalizer
- models/kokoro/kokoro_sentence_splitter
- models/kokoro/kokoro_stages
- models/kokoro/kokoro_stages_ffi
- models/kokoro/kokoro_tokens
- models/kokoro/kokoro_vocab
- models/kokoro/kokoro_web
- models/kokoro/misaki/misaki
- models/kokoro/misaki/misaki_en
- models/kokoro/misaki/misaki_fallback
- models/kokoro/misaki/misaki_fallback_ffi
- models/kokoro/misaki/num2words_en
- models/kokoro/misaki/spacy_en
- models/kokoro/misaki/spacy_hash
- models/kokoro/src/kokoro_client
- models/kokoro/src/kokoro_engine
- models/kokoro/src/kokoro_wire
- models/kokoro/web/kokoro_engine_worker
- models/magika/magika
- models/magika/magika_isolate
- models/magika/magika_model
- models/magika/magika_native
- models/magika/magika_none
- models/magika/magika_web
- models/minilml6v2/mini_lm_l6_v2
- models/minilml6v2/mini_lm_l6_v2_abstract
- models/minilml6v2/mini_lm_l6_v2_native
- models/minilml6v2/mini_lm_l6_v2_web
- models/minishLab/minish_lab
- models/minishLab/minish_lab_abstract
- models/minishLab/minish_lab_native
- models/minishLab/minish_lab_web
- models/msmarcoMiniLmL6V3/msmarco_mini_lm_l6_v3
- models/msmarcoMiniLmL6V3/msmarco_mini_lm_l6_v3_abstract
- models/msmarcoMiniLmL6V3/msmarco_mini_lm_l6_v3_native
- models/msmarcoMiniLmL6V3/msmarco_mini_lm_l6_v3_web
- models/nemoAsr/nemo_asr
- models/nemoAsr/nemo_asr_isolate
- models/nemoAsr/nemo_asr_native
- models/nemoAsr/nemo_asr_none
- models/nemoAsr/nemo_asr_web
- models/nemoAsr/src/nemo_asr_engine
- models/nemoAsr/src/nemo_asr_features
- models/nemoAsr/src/nemo_asr_ort_backend
- models/nemoAsr/src/nemo_asr_vocabulary
- models/pyannote/pyannote
- models/pyannote/pyannote_isolate
- models/pyannote/pyannote_native
- models/pyannote/pyannote_none
- models/pyannote/pyannote_web
- models/senseVoice/sense_voice
- models/senseVoice/sense_voice_isolate
- models/senseVoice/sense_voice_native
- models/senseVoice/sense_voice_none
- models/senseVoice/sense_voice_web
- models/senseVoice/src/sense_voice_engine
- models/senseVoice/src/sense_voice_features
- models/senseVoice/src/sense_voice_ort_backend
- models/sileroVad/silero_vad
- models/sileroVad/silero_vad_isolate
- models/sileroVad/silero_vad_native
- models/sileroVad/silero_vad_none
- models/sileroVad/silero_vad_v6_ffi
- models/sileroVad/silero_vad_web
- models/whisper/src/whisper_engine
- models/whisper/src/whisper_features
- models/whisper/src/whisper_ort_backend
- models/whisper/src/whisper_vocabulary
- models/whisper/whisper
- models/whisper/whisper_isolate
- models/whisper/whisper_native
- models/whisper/whisper_none
- models/whisper/whisper_web
- models/wolfDefender/src/wolf_defender_engine
- models/wolfDefender/src/wolf_defender_ort_backend
- models/wolfDefender/src/wolf_defender_tokenizer
- models/wolfDefender/wolf_defender
- models/wolfDefender/wolf_defender_isolate
- models/wolfDefender/wolf_defender_native
- models/wolfDefender/wolf_defender_none
- models/wolfDefender/wolf_defender_web
- onnx/ort
- onnx/ort_ffi_bindings
- ort_minilm_isolate
- runtime_models
- third_party/diacritic/diacritic
- third_party/diacritic/replacement_map
- tokenizers/bert_vocab
- tokenizers/embedding
- tokenizers/potion_32m_tokenizer
- tokenizers/potion_32m_vocab
- tokenizers/potion_base_8m_vocab
- tokenizers/wordpiece_tokenizer