WebQ
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Speech-to-Speech Question-Answering | WebQ | Accuracy61.5 | 36 | |
| Calibration | WebQ | ECE0.0674 | 31 | |
| Question Answering | WebQ | EM32 | 27 | |
| Speech-to-Text Question-Answering | WebQ | Accuracy66.6 | 26 | |
| Question Answering | WebQ | Accuracy (WebQ)79.66 | 23 | |
| Factuality Evaluation | WebQ | Accuracy (Response)81 | 18 | |
| Web-Page Retrieval | WebQ | Recall75.81 | 13 | |
| Spoken Question Answering | WebQ S→T | Accuracy41.8 | 10 | |
| Multi-hop Question Answering | WebQ 2013 (test) | F1 Score48.3 | 8 | |
| Question Answering | WebQ | Exact Match37.76 | 7 | |
| Information Retrieval | WebQ (test) | Top-20 Acc0.667 | 4 | |
| Retrieval | WebQ | Accuracy (%)81.5 | 2 |
Showing 12 of 12 rows