MS MARCO
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Retrieval | MS MARCO (dev) | MRR@100.401 | 84 | |
| Passage Ranking | MS MARCO (dev) | MRR@1043.3 | 73 | |
| Reranking | MS MARCO (dev) | MRR@1041.4 | 71 | |
| Retrieval | MS MARCO v1 | Retrieval Latency (ms)0.5 | 66 | |
| Information Retrieval | MS MARCO (test) | NDCG@100.714 | 56 | |
| Information Retrieval | MS MARCO | NDCG@1093 | 56 | |
| Open-Domain Question Answering | MS-MARCO | Accuracy91 | 48 | |
| Retrieval-Augmented Generation | MS MARCO | Accuracy (Clean)90 | 45 | |
| Document Retrieval | MS MARCO MS300K (test) | MRR@1057.6 | 36 | |
| RAG Attack | MS-MARCO | Attack Success Rate (ASR)0.8 | 35 | |
| Question Answering | MS-MARCO | ASR85 | 30 | |
| Generative Engine Optimization | MS MARCO | Word Score34.96 | 30 | |
| Knowledge corruption traceback | MS-MARCO | Precision97 | 26 | |
| Information Retrieval | MS MARCO DL2019 | nDCG@1074.6 | 26 | |
| Text Retrieval | MS MARCO Document | MRR@1045.9 | 26 | |
| Text Retrieval | MS MARCO Passage | MRR@100.437 | 26 | |
| Document Ranking | MS MARCO Document | FD (%)74 | 24 | |
| Document Ranking | MS MARCO Passage | FD (%)82 | 24 | |
| Downstream generation | MS MARCO | Substring ASR92 | 24 | |
| Document Retrieval | MS MARCO Document (dev) | MRR@1000.479 | 24 | |
| Retrieval | MS MARCO | D (MRR@10)0.433 | 21 | |
| Text Reconstruction from Embeddings | MS MARCO | BLEU-134.44 | 20 | |
| Information Retrieval | MS MARCO TREC DL19 1.0 (test) | nDCG@100.648 | 20 | |
| Retrieval | MS MARCO | Recall97.1 | 20 | |
| Document Reranking | MS MARCO Document DL19 | nDCG@1072.1 | 18 |
Showing 25 of 106 rows