Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Spoken SQuAD: A Study of Mitigating the Impact of Speech Recognition Errors on Listening Comprehension

About

Reading comprehension has been widely studied. One of the most representative reading comprehension tasks is Stanford Question Answering Dataset (SQuAD), on which machine is already comparable with human. On the other hand, accessing large collections of multimedia or spoken content is much more difficult and time-consuming than plain text content for humans. It's therefore highly attractive to develop machines which can automatically understand spoken content. In this paper, we propose a new listening comprehension task - Spoken SQuAD. On the new task, we found that speech recognition errors have catastrophic impact on machine comprehension, and several approaches are proposed to mitigate the impact.

Chia-Hsuan Li, Szu-Lin Wu, Chi-Liang Liu, Hung-yi Lee• 2018

Related benchmarks

TaskDatasetResultRank
Question AnsweringSpoken-SQuAD 1.1 (test)
EM49.07
7
Spoken Question AnsweringSpoken SQuAD No noise (test)
EM45.78
5
Spoken Question AnsweringSpoken SQuAD NoiseV1 (test)
EM29.73
5
Spoken Question AnsweringSpoken SQuAD NoiseV2 (test)
EM20.66
5
Showing 4 of 4 rows

Other info

Code

Follow for update