MS MARCO
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Retrieval | MS MARCO (dev) | MRR@100.401 | 84 | |
| Passage Ranking | MS MARCO (dev) | MRR@1043.3 | 73 | |
| Reranking | MS MARCO (dev) | MRR@1041.4 | 71 | |
| Retrieval | MS MARCO v1 | Retrieval Latency (ms)0.5 | 57 | |
| Information Retrieval | MS MARCO (test) | NDCG@100.714 | 56 | |
| Information Retrieval | MS MARCO | NDCG@1093 | 56 | |
| Open-Domain Question Answering | MS-MARCO | Accuracy91 | 48 | |
| RAG Attack | MS-MARCO | Attack Success Rate (ASR)0.8 | 35 | |
| Question Answering | MS-MARCO | ASR85 | 30 | |
| Generative Engine Optimization | MS MARCO | Word Score34.96 | 30 | |
| Knowledge corruption traceback | MS-MARCO | Precision97 | 26 | |
| Information Retrieval | MS MARCO DL2019 | nDCG@1074.6 | 26 | |
| Text Retrieval | MS MARCO Document | MRR@1045.9 | 26 | |
| Text Retrieval | MS MARCO Passage | MRR@100.437 | 26 | |
| Document Ranking | MS MARCO Document | FD (%)74 | 24 | |
| Document Ranking | MS MARCO Passage | FD (%)82 | 24 | |
| Downstream generation | MS MARCO | Substring ASR92 | 24 | |
| Document Retrieval | MS MARCO Document (dev) | MRR@1000.479 | 24 | |
| Text Reconstruction from Embeddings | MS MARCO | BLEU-134.44 | 20 | |
| Information Retrieval | MS MARCO TREC DL19 1.0 (test) | nDCG@100.648 | 20 | |
| Retrieval | MS MARCO | Recall97.1 | 20 | |
| Information Retrieval | MS MARCO in-domain | NDCG@100.473 | 18 | |
| Information Retrieval | MS MARCO BEIR | NDCG@1047 | 17 | |
| Web Search Retrieval | MS MARCO (dev) | MRR@100.452 | 17 | |
| Passage Retrieval | MS MARCO (dev) | MRR@1043.1 | 17 |
Showing 25 of 87 rows