SciFact
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Information Retrieval | SciFact (test) | NDCG@100.906 | 65 | |
| Information Retrieval | SciFact | nDCG@1077.77 | 36 | |
| Information Retrieval | SciFact BEIR (test) | nDCG@1076.6 | 31 | |
| Scientific Fact Verification | SciFact | Macro F183.03 | 25 | |
| Information Retrieval | scifact | Recall@10096.7 | 19 | |
| Information Retrieval | SciFact | Faithfulness67 | 18 | |
| Information Retrieval | SciFact BEIR | NDCG@1085.4 | 17 | |
| Information Retrieval | SciFact | nDCG@100.77 | 16 | |
| Information Retrieval | Scifact | nDCG82 | 15 | |
| Fact-checking | SCIFact | Balanced Acc90.3 | 15 | |
| Reranking | SciFact | nDCG76.4 | 12 | |
| Logical Retrieval | SciFact BEIR v1 (test) | nDCG@100.64 | 12 | |
| Claim Verification | SCIFACT | Accuracy94.32 | 12 | |
| Retrieval | SciFact-G | R@1035.1 | 10 | |
| Sentence-Level Confidence Prediction | SciFact | AUROC0.544 | 10 | |
| Information Retrieval | SciFact | NDCG@1072.07 | 7 | |
| Retrieval | SciFact | nDCG@10.56 | 6 | |
| Document Retrieval | SciFact | nDCG@544 | 6 | |
| Retrieval | SciFact EN | nDCG@1032.35 | 6 | |
| Scientific Claim Verification | SciFact | Accuracy40.5 | 6 | |
| Adversarial Attack | SciFact | Contriever Score29.08 | 6 | |
| Information Retrieval | SciFact | Accuracy75.14 | 6 | |
| Information Retrieval | SciFact BEIR | nDCG0.708 | 5 | |
| Scientific Claim Verification | SciFact (test) | Precision (NE)93 | 4 | |
| Document reranking | SciFact | NDCG@1080.15 | 4 |
Showing 25 of 33 rows