Trec
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Text Classification | TREC | Accuracy98 | 311 | |
| Question Classification | TREC | Accuracy98.07 | 274 | |
| Question Classification | TREC (test) | Accuracy97.53 | 150 | |
| Reranking | TREC DL 2020 | NDCG@1070.86 | 132 | |
| Text Classification | TREC (test) | Accuracy97.2 | 132 | |
| Reranking | TREC 2020 (test) | NDCG@1070.9 | 55 | |
| Query Performance Prediction | TREC DL'19 and DL'20 (2-fold train-test) | AP-τ40.33 | 48 | |
| 6-way question classification | TREC 6-class (test) | Accuracy97.6 | 41 | |
| Privacy Auditing | Trec | Empirical Privacy Lower Bound (ϵ_emp)0 | 40 | |
| Reranking | TREC | NDCG@5 (DL19)74.45 | 35 | |
| Text Classification | Trec synthetic noise (test) | Accuracy97.2 | 34 | |
| Question Classification | TREC50 | Generalization Error G(W)1.36 | 30 | |
| Question Classification | TREC LongBench | Accuracy68.5 | 30 | |
| Question Classification | TREC | Macro-F172.75 | 30 | |
| Text Classification | TREC (val) | Top-1 Acc93.54 | 30 | |
| Text Classification | TREC | Macro F1 Score86.2 | 26 | |
| Classification | trec6 | Accuracy93.7 | 26 | |
| Information Retrieval | TREC DL | NDCG@1093.4 | 25 | |
| Question Classification | TREC | Spearman's rho (x100)78.72 | 23 | |
| Text Classification | Trec Merge Imbalance, with Label Noise (pool) | Balanced Accuracy62.43 | 22 | |
| End-to-end Open-Domain Question Answering | TREC (test) | Exact Match (EM)63.1 | 21 | |
| Question Classification | TREC 50 (test) | Accuracy97.2 | 21 | |
| Clinical Trial Matching | TREC 2023 | Accuracy76.5 | 20 | |
| Clinical Trial Matching | TREC 2022 | Accuracy76.5 | 20 | |
| Clinical Trial Matching | TREC 2021 | Accuracy72 | 20 |
Showing 25 of 86 rows