SCIDOCS
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Information Retrieval | SCIDocs | nDCG@1023.11 | 24 | |
| Scientific Document Retrieval | SciDocs (dev) | Cite90.4 | 22 | |
| Membership Inference Attack | SCIDOCS | AUC0.991 | 20 | |
| Passage Reranking | SciDocs BEIR | NDCG@1016.96 | 19 | |
| Information Retrieval | SCIDOCS | NDCG@1018.3 | 19 | |
| Retrieval | SCIDOCS | nDCG@1024.01 | 18 | |
| Reranking | SciDocs (test) | MAP72.22 | 16 | |
| Information Retrieval | SCIDOCS (test) | NDCG@1016.7 | 16 | |
| Scientific Document Representation Evaluation | SCIDOCS (test) | MAG F187.1 | 13 | |
| Corpus Stealing Attack | SciDocs v1 (test) | CR0 | 12 | |
| Membership Inference Attack Detection | SCIDOCS | Recall99.8 | 10 | |
| Recommendation | SCIDOCS Recommendation | nDCG0.539 | 10 | |
| Citation prediction | SCIDOCS Co-Cite | MAP88.1 | 10 | |
| Citation prediction | SCIDOCS Cite | MAP91.6 | 10 | |
| User activity prediction | SCIDOCS Co-Read | MAP84.5 | 10 | |
| User activity prediction | SCIDOCS Co-View | MAP83.6 | 10 | |
| Classification | SCIDOCS MeSH | F1 Score86.4 | 10 | |
| Classification | SCIDOCS MAG | F10.82 | 10 | |
| Information Retrieval | SciDocs Full Cocite CoRead CoView F2F | Recall@566.25 | 9 | |
| Vector Linking | SciDocs | Precision82.8 | 8 | |
| Retrieval | SciDocs (Cocite) | Recall@1096.16 | 6 | |
| Document Retrieval | SciDocs | nDCG@521.3 | 6 | |
| Information Retrieval | Scidocs BEIR | nDCG0.29 | 6 | |
| Adversarial Attack | SCIDOCS | Contriever Score27.02 | 6 | |
| Information Retrieval | SCIDOCS | Accuracy22.55 | 6 |
Showing 25 of 37 rows