Pinch translates speech into other languages for voice agents, live calls, and recorded media. Two services cover the two timescales: a real-time translation API that streams microphone or call audio over a WebSocket and returns translated audio plus transcripts, and an asynchronous dubbing API that takes audio or video files and returns a dubbed version in another language.
The real-time API runs in speech-to-speech or speech-to-translated-text mode and needs no SDK. It accepts 32 input languages (ISO-639-1 codes, regional variants accepted); 30 of them also have synthesized voice output, while Filipino and Cantonese return text only. Passing auto as the source language turns on language detection. The relay-1 translation model emits transcription, translated transcription, and speech output at the same time and is offered via API and on-prem deployment.
Dubbing keeps the original speaker's voice and tone, phrases the translation the way a native speaker would rather than word for word, and isolates speech so music, ambience, and sound design pass through unchanged. A browser studio lets you check speaker identification, reassign or merge speakers, and edit the transcript and translation before generating the dub. Pinch also publishes research on JEPA-based audio encoders for voice-preserving speech-to-speech translation.
Features
- Real-time translation API: WebSocket streaming at ws.startpinch.com that returns translated audio and transcripts as you speak
- Dubbing API: asynchronous REST service at api.startpinch.com for localizing audio and video files, billed per minute
- Language coverage: 32 input languages, 30 with voice output, with auto-detection of the source language
- Voice library: 70 voices (30 female, 40 male), each able to speak every voice-output language while keeping the same identity
- Voice selection: choose a voice by ID or fall back to a gender preference through voiceType
- Voice and background preservation: dubbed output keeps the speaker's voice and the original music and ambience
- Dubbing studio: preview speaker identification and edit transcripts and translations in the browser before generating
- Deployment options: hosted API or on-prem deployment of the relay-1 model
- Claude integration: an Add to Claude entry point exposes the service to the Claude assistant