TREC-COVID
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Information Retrieval | TREC-COVID | NDCG@1087 | 44 | |
| Information Retrieval | TREC-COVID BEIR | NDCG@1095 | 17 | |
| Corpus Stealing Attack | TREC-COVID v1 (test) | CR54.4 | 12 | |
| Information Retrieval | TREC-COVID (test) | NDCG@1073.8 | 9 | |
| Information Retrieval | TREC-COVID CORD-19 (Round 4) | nDCG@200.7843 | 7 | |
| Information Retrieval | TREC-COVID Round 5 (Expert 50) | nDCG@1082.82 | 6 | |
| Information Retrieval | TREC-COVID Para C - Keyword-heavy graded | nDCG@1080.8 | 5 | |
| Information Retrieval | TREC-COVID Para B Semi-technical graded | nDCG@1071.5 | 5 | |
| Information Retrieval | TREC-COVID Conversational graded (Para A) | nDCG@1076.3 | 5 | |
| Information Retrieval | TREC-COVID Expert 50 graded | nDCG@1082.8 | 5 | |
| Re-ranking | TREC-COVID | MRR100 | 5 | |
| Passage Reranking | TREC-COVID (test) | MAP0.3187 | 5 | |
| Information Retrieval | TREC-COVID CORD-19 (Round 2) | nDCG@1068.93 | 5 | |
| Information Retrieval | TREC-COVID Biomedical | MRR1 | 4 | |
| Information Retrieval | TREC-COVID | QPS85.64 | 4 | |
| RAG Reconstruction Fidelity | TREC-COVID | Success Rate38.39 | 3 | |
| Knowledge Base Stealing | TREC-COVID (test) | Metric- | 0 |
Showing 17 of 17 rows