WebQ
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Calibration | WebQ | ECE0.0674 | 31 | |
| Question Answering | WebQ | EM32 | 27 | |
| Speech-to-Text Question-Answering | WebQ | Accuracy66.6 | 23 | |
| Factuality Evaluation | WebQ | Accuracy (Response)81 | 18 | |
| Speech-to-Speech Question-Answering | WebQ | Accuracy61.5 | 13 | |
| Question Answering | WebQ | Accuracy (WebQ)67.94 | 8 | |
| Multi-hop Question Answering | WebQ 2013 (test) | F1 Score48.3 | 8 | |
| Question Answering | WebQ | Exact Match37.76 | 7 | |
| Information Retrieval | WebQ (test) | Top-20 Acc0.667 | 4 | |
| Retrieval | WebQ | Accuracy (%)81.5 | 2 |
Showing 10 of 10 rows