Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

What Was That Again? Certified Robustness for Automatic Speech Recognition

About

Automatic Speech Recognition systems are notoriously both sensitive to adversarial and benign perturbations. While this has been repeatedly demonstrated using reference datasets, detecting such behaviors in deployed systems is incredibly challenging, due to the absence of oracle knowledge of the true transcription. We demonstrate that employing a certification-inspired mechanism can significantly decrease WER, increase recall, and decrease the Spearman correlation between confidence and WER. We achieve this through a dual-gate diagnostic pipeline: a Two-Sided Atomic Audit that accumulates statistical wealth to certify both token existence and adversarial exclusion, and a Rank-Based Tournament that selects the winning sequence. Our evaluations across four diverse architectures demonstrate up to a 55% relative reduction in Word Error Rate, while also providing granular word- and sentence-level certifications to enhance acoustic security.

Andrew C. Cullen, Neil G. Marchant, Jiani Xie, Paul Montague, Benjamin I.P. Rubinstein• 2026

Related benchmarks

TaskDatasetResultRank
Automatic Speech RecognitionLibriSpeech and Common Voice
WER0.051
64
Showing 1 of 1 rows

Other info

Follow for update