ViDoRe
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Document Retrieval | ViDoRe Avg. across 4 datasets v2 | Full NDCG0.58 | 45 | |
| Visual document retrieval | ViDoRe V2 | Avg nDCG@566.9 | 39 | |
| Visual Document Retrieval | ViDoRe v2 (test) | ESG Score (Human)66.4 | 23 | |
| Generation | ViDoRe AI v1 (test) | ASR-G Similarity (mean) @-11 | 23 | |
| Document Retrieval | ViDoRe AI v1 (test) | Delta Recall@10.19 | 23 | |
| Visual document retrieval | ViDoRe V3 | HR66.32 | 23 | |
| Document Retrieval | ViDoRe V1 | Arxiv Score88.1 | 23 | |
| Visual Document Retrieval | ViDoRe2 Average (val) | nDCG@563.3 | 18 | |
| Visual Document Retrieval | ViDoRe ESG Full 2 (val) | nDCG@563.1 | 18 | |
| Visual Document Retrieval | ViDoRe2 ESG Human (val) | nDCG@572.6 | 18 | |
| Visual Document Retrieval | ViDoRe Biomed 2 (val) | nDCG@561.2 | 18 | |
| Hybrid Retrieval | ViDoRe 1 | Avg Performance Score94.1 | 18 | |
| Targeted Attack | ViDoRe AI V1 | ASR-R@1 (mean)100 | 18 | |
| Multimodal Reranking | ViDoRe English | NDCG@560 | 16 | |
| Visual Document Retrieval | ViDoRe V1+V2 (test) | ArXiv NDCG@593.8 | 15 | |
| Visual Document Retrieval | ViDoRe 8 datasets v3 | NDCG@559 | 14 | |
| Visual Document Retrieval | ViDoRe 10 datasets v1 | NDCG@590.6 | 14 | |
| Visual Document Retrieval | ViDoRe Out-of-domain V2 | NDCG@5 (ESG Human)67.9 | 13 | |
| Visual Document Retrieval | ViDoRe | ArxivQ Score87.3 | 12 | |
| Retrieval | ViDoRe V3 (test) | Accuracy (Computer Science)79.3 | 12 | |
| Hybrid Retrieval | ViDoRe 1 | Performance Score65.15 | 12 | |
| Visual Document Retrieval | ViDoRe In-Domain V1 (test) | Arxiv Domain Performance88 | 12 | |
| Visual Document Retrieval | Vidore 2 | nDCG@1072.8 | 11 | |
| Visual Document Retrieval | Vidore v1 | nDCG@1091.9 | 11 | |
| Targeted Poisoning Attack | ViDoRe AI (Targeted Setting II: 5 queries, 1 answer) V1 | ASR @1 (mean)88 | 10 |
Showing 25 of 47 rows