Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

NAVER LABS Europe Submission to the Instruction-following 2026 Short Track

About

In this paper, we describe NAVER LABS Europe's submission to the instruction-following speech processing short track at IWSLT 2026. We participate again in the constrained setting, developing systems capable of jointly performing ASR, ST, and SQA from English speech into Chinese, Italian, and German. Building on our previous submission, ranked first in last year's short track, we update our multi-stage training pipeline by replacing the speech projector with SpeechMapper, a method for learning a speech-to-LLM embedding projector using only ASR data. In addition, we introduce a synthetic SQA dataset, fakACL, composed of artificially generated scientific presentations. This dataset is built by prompting the LLM backbone, segmenting the generated talks, and synthesizing speech with SeamlessM4T-large-v2. The combination of an improved speech projection mechanism and domain-specific synthetic data allows our model to outperform last year's best short-track system, while being considerably more compact and relying on a weaker LLM backbone. This year's results place our system tied for first place in the overall short track ranking.

Marcely Zanon Boito, Hemant Yadav, Jean-Luc Meunier, Ioan Calapodescu• 2026

Related benchmarks

TaskDatasetResultRank
Speech Translation / Machine TranslationCoVoST2, EuroParlST Weighted Average (test)
Score (en-de)80.7
9
Speech Question AnsweringLibriSQA Part I 1.0
Accuracy89.9
7
Speech Question AnsweringLibriSQA Part II 1.0
Accuracy82.6
7
Automatic Speech RecognitionLibriSpeech (clean other), EuroParlST, CoVoST2 (Weighted Average) (test)
WER7.4
5
Automatic Speech RecognitionLibriSpeech clean other EuroParlST CoVoST2
MCIF10.5
4
Spoken Question AnsweringLibriSQA Part I and Part II
MCIF42.8
4
Instruction FollowingIWSLT IF short track (en) 2026 (official)
QA-BERTScore53.1
2
Instruction FollowingIWSLT IF short track (it) 2026 (official)
TRANS-COMET0.763
2
Instruction FollowingIWSLT IF short track (de) 2026 (official)
TRANS-COMET0.765
2
Instruction FollowingIWSLT IF short track (zh) 2026 (official)
TRANS-COMET0.794
2
Showing 10 of 10 rows

Other info

Follow for update