“I'm building a Danish customer-service voice agent. Which open speech-to-text model should I use for Danish phone audio? Name specific models.”
Full answer
For Danish telephony audio, use these specific open models:
1. **`alexandrainst/whisper-large-v3-da`** (Alexandra Institute)
* The best-performing open model for conversational Danish. Fine-tuned on local Danish speech datasets (including Common Voice and conversational data), it significantly outperforms base Whisper on dialectal nuances and telephony noise.
2. **`openai/whisper-large-v3-turbo`**
* If latency is a bottleneck, deploy the official Turbo model. It handles Danish well and provides roughly 4x faster inference than standard Large-v3.
3. **`chcaa/nordic-wav2vec2-large-danish`** (CHCAA / Aarhus University)
* A non-autoregressive CTC model. Use this if you need ultra-low-latency real-time streaming (under 200ms TTFT), though it lacks Whisper's robust punctuation and casing.
**Serving Stack:**
* **Engine:** Deploy the Whisper model using **`faster-whisper`** (CTranslate2 backend) with 8-bit quantization (`int8_float16`) to fit telephony latency budgets (<500ms).
* **Pipeline/Orchestration:** Integrate via **Pipecat** or **LiveKit Agents** framework, using **Silero VAD** for voice activity detection. Ensure you upsample 8kHz phone audio to 16kHz via **SoX** or **Torchaudio** before inference to avoid severe Whisper hallucination.