ArguAna
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| End-to-End Defense in RAG | ArguAna | Attack Success Rate (ASR)0 | 63 | |
| Information Retrieval | ArguAna BEIR | NDCG@1084.9 | 33 | |
| Information Retrieval | ArguAna | nDCG@1066.15 | 31 | |
| Information Retrieval | ArguAna | NDCG@10 (Dense)41.6 | 21 | |
| Passage Reranking | ArguAna BEIR | NDCG@1036.59 | 19 | |
| Logical Retrieval | ArguAna BEIR v1 (test) | nDCG@100.67 | 12 | |
| Information Retrieval | Arguana BEIR | nDCG90 | 11 | |
| Information Retrieval | ArguAna | QPS6,924 | 9 | |
| Information Retrieval | ArguAna (test) | NDCG@1049.1 | 9 | |
| Vector Linking | ArguAna | Precision77.1 | 8 | |
| RAG Utility Evaluation | ArguAna | Hit Rate55.6 | 7 | |
| Information Retrieval | ArguAna | Accuracy65.07 | 6 | |
| Information Retrieval | ArguAna nanoBEIR slice | nDCG@1072.97 | 4 | |
| Information Retrieval | ArguAna Arguments | MRR99.5 | 4 | |
| Dense Retrieval | ArguAna | Relative Improvement (%)29.8 | 4 | |
| Information Retrieval | ArguAna | nDCG@1036.45 | 3 | |
| Information Retrieval | ArguAna BEIR v1.0 (test) | nDCG@1038.78 | 2 | |
| Information Retrieval | ArguAna BEIR | Latency (ms)0.24 | 2 | |
| Retrieval | ArguAna | H2D Latency (ms)6.72 | 1 |
Showing 19 of 19 rows