NAVER LABS Europe Submission to the Instruction-following 2026 Short Track
About
In this paper, we describe NAVER LABS Europe's submission to the instruction-following speech processing short track at IWSLT 2026. We participate again in the constrained setting, developing systems capable of jointly performing ASR, ST, and SQA from English speech into Chinese, Italian, and German. Building on our previous submission, ranked first in last year's short track, we update our multi-stage training pipeline by replacing the speech projector with SpeechMapper, a method for learning a speech-to-LLM embedding projector using only ASR data. In addition, we introduce a synthetic SQA dataset, fakACL, composed of artificially generated scientific presentations. This dataset is built by prompting the LLM backbone, segmenting the generated talks, and synthesizing speech with SeamlessM4T-large-v2. The combination of an improved speech projection mechanism and domain-specific synthetic data allows our model to outperform last year's best short-track system, while being considerably more compact and relying on a weaker LLM backbone. This year's results place our system tied for first place in the overall short track ranking.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Speech Translation / Machine Translation | CoVoST2, EuroParlST Weighted Average (test) | Score (en-de)80.7 | 9 | |
| Speech Question Answering | LibriSQA Part I 1.0 | Accuracy89.9 | 7 | |
| Speech Question Answering | LibriSQA Part II 1.0 | Accuracy82.6 | 7 | |
| Automatic Speech Recognition | LibriSpeech (clean other), EuroParlST, CoVoST2 (Weighted Average) (test) | WER7.4 | 5 | |
| Automatic Speech Recognition | LibriSpeech clean other EuroParlST CoVoST2 | MCIF10.5 | 4 | |
| Spoken Question Answering | LibriSQA Part I and Part II | MCIF42.8 | 4 | |
| Instruction Following | IWSLT IF short track (en) 2026 (official) | QA-BERTScore53.1 | 2 | |
| Instruction Following | IWSLT IF short track (it) 2026 (official) | TRANS-COMET0.763 | 2 | |
| Instruction Following | IWSLT IF short track (de) 2026 (official) | TRANS-COMET0.765 | 2 | |
| Instruction Following | IWSLT IF short track (zh) 2026 (official) | TRANS-COMET0.794 | 2 |