MS MARCO
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Retrieval | MS MARCO (dev) | MRR@100.401 | 84 | |
| Passage Ranking | MS MARCO (dev) | MRR@1043.3 | 73 | |
| Reranking | MS MARCO (dev) | MRR@1041.4 | 71 | |
| Retrieval | MS MARCO v1 | Retrieval Latency (ms)0.5 | 57 | |
| Information Retrieval | MS MARCO (test) | NDCG@100.714 | 56 | |
| Information Retrieval | MS MARCO | NDCG@1093 | 56 | |
| Information Retrieval | MS MARCO DL2019 | nDCG@1074.6 | 26 | |
| Text Retrieval | MS MARCO Document | MRR@1045.9 | 26 | |
| Text Retrieval | MS MARCO Passage | MRR@100.437 | 26 | |
| Document Retrieval | MS MARCO Document (dev) | MRR@1000.479 | 24 | |
| Text Reconstruction from Embeddings | MS MARCO | BLEU-134.44 | 20 | |
| Information Retrieval | MS MARCO TREC DL19 1.0 (test) | nDCG@100.648 | 20 | |
| Retrieval | MS MARCO | Recall97.1 | 20 | |
| Information Retrieval | MS MARCO in-domain | NDCG@100.473 | 18 | |
| Web Search Retrieval | MS MARCO (dev) | MRR@100.452 | 17 | |
| Passage Retrieval | MS MARCO (dev) | MRR@1043.1 | 17 | |
| Information Retrieval | MS Marco | NDCG@1044.2 | 15 | |
| Document Retrieval | MS MARCO MS300K (test) | MRR@1057.6 | 14 | |
| Passage Retrieval | MS MARCO passage (dev) | NDCG@100.4134 | 14 | |
| Question Answering | MS MARCO randomly selected 150 data points | BAR100 | 14 | |
| Document Retrieval | MS Marco 300k (dev) | Hits@10.6032 | 14 | |
| Document Retrieval | MS Marco 100k (dev) | Hits@170.74 | 14 | |
| Text Ranking | MS MARCO In-domain suite (TREC DL19, TREC DL20) v1 (dev test) | NDCG@10 (Sparse, BM25, MS MARCO)0.48 | 13 | |
| Information Retrieval | MS MARCO (dev) | NDCG@1032.92 | 12 | |
| Document Ranking | MS MARCO Document 200 sampled queries (test) | Top-5 Success Rate93 | 12 |
Showing 25 of 62 rows