mlx_audio 0.2.0

On-device speech for Apple Silicon: Parakeet-TDT and Whisper speech-to-text and PocketTTS text-to-speech, built on the mlx array framework via mlx-c.

Changelog

0.2.0 - 2026-07-26

• Added interface-level STT generation parameters, typed inference progress, and cooperative cancellation.
• Added deterministic, idempotent model cleanup through close().
• Added true incremental PocketTTS PCM callbacks while preserving the complete TtsOutput return value.

0.1.0 - 2026-07-19

Initial release: on-device speech models for Apple Silicon, built on the mlx package.

• Speech-to-text:
  • Parakeet-TDT — log-mel front-end → Conformer encoder → RNN-T predict/joint → TDT greedy decode, loading the real mlx-community/parakeet-tdt-0.6b-v2 checkpoint.
  • Whisper — mel front-end → encoder → greedy KV-cache decode with >30 s tiled chunking; loads HuggingFace fp32, mlx-whisper fp16, and 4-bit / 8-bit quantized safetensors, with automatic tokenizer fallback by vocab size.
• Text-to-speech: PocketTTS — FlowLM backbone + flow-matching latent sampler → Mimi neural codec, synthesizing a 24 kHz waveform from text with eight predefined voices.
• DSP / audio: STFT + log-mel front-end, float32 WAV I/O, resampling, and mono-16 kHz loading.
• Model management: a Hugging Face hub client that snapshots repos into a local cache (resolveOrDownloadModel, HubProgress).
• Eval utilities: transcript normalization and word-error-rate.
• CLIs: mlx_audio:transcribe (STT) and mlx_audio:say (TTS).