MS MARCO
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Retrieval | MS MARCO (dev) | MRR@100.401 | 84 | |
| Open-Domain Question Answering | MS-MARCO | Accuracy91 | 78 | |
| Passage Ranking | MS MARCO (dev) | MRR@1077.1 | 75 | |
| Reranking | MS MARCO (dev) | MRR@1041.4 | 71 | |
| Retrieval | MS MARCO v1 | Retrieval Latency (ms)0.5 | 66 | |
| Information Retrieval | MS MARCO (test) | NDCG@100.714 | 56 | |
| Information Retrieval | MS MARCO | NDCG@1093 | 56 | |
| Document Retrieval | MS MARCO | Recall@1100 | 50 | |
| Retrieval-Augmented Generation | MS MARCO | Accuracy (Clean)90 | 45 | |
| RAG Poisoning Attack | MS MARCO | E2E Attack Success Rate82.04 | 36 | |
| Document Retrieval | MS MARCO MS300K (test) | MRR@1057.6 | 36 | |
| Lexical Retrieval | MS MARCO | Recall@599.8 | 35 | |
| RAG Attack | MS-MARCO | Attack Success Rate (ASR)0.8 | 35 | |
| Document Retrieval | MS MARCO document retrieval (DL'19) | NDCG@1073 | 32 | |
| Question Answering | MS-MARCO | ASR85 | 30 | |
| Generative Engine Optimization | MS MARCO | Word Score34.96 | 30 | |
| Knowledge corruption traceback | MS-MARCO | Precision97 | 26 | |
| Information Retrieval | MS MARCO DL2019 | nDCG@1074.6 | 26 | |
| Text Retrieval | MS MARCO Document | MRR@1045.9 | 26 | |
| Text Retrieval | MS MARCO Passage | MRR@100.437 | 26 | |
| Document Retrieval | MS MARCO document retrieval (DL'20) | NDCG@1072 | 25 | |
| Document Ranking | MS MARCO Document | FD (%)74 | 24 | |
| Document Ranking | MS MARCO Passage | FD (%)82 | 24 | |
| Downstream generation | MS MARCO | Substring ASR92 | 24 | |
| Document Retrieval | MS MARCO Document (dev) | MRR@1000.479 | 24 |
Showing 25 of 137 rows