SCIDOCS
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Information Retrieval | SCIDocs | nDCG@1023.11 | 24 | |
| Scientific Document Retrieval | SciDocs (dev) | Cite90.4 | 22 | |
| Reranking | SciDocs (test) | MAP72.22 | 16 | |
| Information Retrieval | SCIDOCS (test) | NDCG@1016.7 | 16 | |
| Scientific Document Representation Evaluation | SCIDOCS (test) | MAG F187.1 | 13 | |
| Retrieval | SCIDOCS | nDCG@1024.01 | 12 | |
| Corpus Stealing Attack | SciDocs v1 (test) | CR0 | 12 | |
| Recommendation | SCIDOCS Recommendation | nDCG0.539 | 10 | |
| Citation prediction | SCIDOCS Co-Cite | MAP88.1 | 10 | |
| Citation prediction | SCIDOCS Cite | MAP91.6 | 10 | |
| User activity prediction | SCIDOCS Co-Read | MAP84.5 | 10 | |
| User activity prediction | SCIDOCS Co-View | MAP83.6 | 10 | |
| Classification | SCIDOCS MeSH | F1 Score86.4 | 10 | |
| Classification | SCIDOCS MAG | F10.82 | 10 | |
| Information Retrieval | Scidocs BEIR | nDCG0.29 | 6 | |
| Adversarial Attack | SCIDOCS | Contriever Score27.02 | 6 | |
| Information Retrieval | SCIDOCS | Accuracy22.55 | 6 | |
| Multi-Vector Retrieval | SCIDOCS | QPS3,353 | 5 | |
| Information Retrieval | SCIDOCS | MAP@10012.8 | 4 | |
| Dense Retrieval | SciDocs | Relative Improvement (%)13.4 | 4 | |
| Information Retrieval | SCIDOCS | QPS767.05 | 4 | |
| RAG Reconstruction Fidelity | SciDocs | Success Rate38.1 | 3 | |
| Reranking | SciDocs RR | Spearman Correlation0.861 | 1 | |
| Knowledge Base Stealing | SciDocs (test) | Metric- | 0 |
Showing 24 of 24 rows