Share your thoughts, 1 month free Claude Pro on us
See more
Feedback
Search any
task
Search any
task
SOTA Spoken Question Answering benchmarks and papers with code | Wizwand
Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Tasks
Spoken Question Answering
Benchmarks
Dataset Name
SOTA Method
Dataset Name
SOTA Method
Metric
Trend
Results
Last Updated
S-SQuAD (test)
ALBERT-base + DA + KD
EM
64.1
16
3mo ago
TriviaQA
VIRBA
Accuracy
65.2
15
13d ago
Spoken-SQuAD
contr-cos-all + asr + giga
EM
76.11
15
3mo ago
SQuAD v1.1 (test)
AEG (with LFE)
EM
89.24
12
2mo ago
MuSiQue v1.0 (test)
AEG (with LFE)
Exact Match (EM)
53.99
12
2mo ago
HotpotQA v1.0 (test)
AEG (with LFE)
Exact Match (EM)
79.16
12
2mo ago
Web Questions
Fun-Audio-Chat-8B
Accuracy
44.59
12
1mo ago
LibriSQA Part II
Transcripts + Llama 3.1 8B
Accuracy
74.9
11
3mo ago
LibriSQA (Part I)
Transcripts + EuroLLM 9B
Accuracy
87.6
11
3mo ago
Spoken SQuAD (test)
Transcripts + EuroLLM 9B
Accuracy
91.1
11
3mo ago
OpenAudioBench
MiniCPM-o 4.5
Accuracy
74.82
9
8d ago
VoiceBench
Raon-Speech
Accuracy
76.79
9
8d ago
UltraEval-Audio S2S
GPT-Audio
AlpacaEval Score
0.7338
9
3mo ago
Spoken SQuAD (B) ASR (test)
Ensembled [(e) plus (d)]
EM
60.37
9
3mo ago
KOpenAudioBench
Raon-Speech
Accuracy
52.1
8
8d ago
KVoiceBench
Raon-Speech
Accuracy
66.62
8
8d ago
Our Bench
Serial
Accuracy
76.34
8
3mo ago
Spoken-MQA
Serial
Accuracy
83.95
8
3mo ago
VERA
Serial
Accuracy
18.54
8
3mo ago
AlpacaEval
LLaMA-Omni2
WER
3.88
7
22d ago
Llama Questions
Qwen2.5-Omni-7B
WER
0.99
7
2mo ago
WebQuestions
Freeze-Omni
Text Score
40.8
6
22d ago
TriviaQA
Freeze-Omni
Text Score
45.1
6
22d ago
LLaMAQ
Freeze-Omni
Text Score
74.2
6
22d ago
Spoken SQuAD NoiseV2 (test)
BiDAF (WORD+CHAR+PHONEME+SYLLABLE)
EM
20.66
5
3mo ago
Showing 25 of 31 rows
25 / page
50 / page
100 / page
1
2
Search any
task
Search any
task
Privacy Policy
Terms of Service
FAQs
Swarm Docs
