Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ViDoRe

Benchmarks

Task NameDataset NameSOTA ResultTrend
Visual Document RetrievalViDoRe Avg. across 4 datasets v2
Full NDCG0.58
45
Visual document retrievalViDoRe V2
Bio Score62.4
36
GenerationViDoRe AI v1 (test)
ASR-G Similarity (mean) @-11
23
Document RetrievalViDoRe AI v1 (test)
Delta Recall@10.19
23
Visual document retrievalViDoRe V3
HR66.32
23
Document RetrievalViDoRe V1
Arxiv Score88.1
23
Visual Document RetrievalViDoRe2 Average (val)
nDCG@563.3
18
Visual Document RetrievalViDoRe ESG Full 2 (val)
nDCG@563.1
18
Visual Document RetrievalViDoRe2 ESG Human (val)
nDCG@572.6
18
Visual Document RetrievalViDoRe Biomed 2 (val)
nDCG@561.2
18
Hybrid RetrievalViDoRe 1
Avg Performance Score94.1
18
Targeted AttackViDoRe AI V1
ASR-R@1 (mean)100
18
Visual Document RetrievalViDoRe 8 datasets v3
NDCG@559
14
Visual Document RetrievalViDoRe 10 datasets v1
NDCG@590.6
14
Visual Document RetrievalViDoRe Out-of-domain V2
NDCG@5 (ESG Human)67.9
13
Hybrid RetrievalViDoRe 1
Performance Score65.15
12
Visual Document RetrievalViDoRe In-Domain V1 (test)
Arxiv Domain Performance88
12
Visual Document RetrievalViDoRe v2 (test)
ESG Score (Human)65.8
11
Visual Document RetrievalVidore 2
nDCG@1072.8
11
Visual Document RetrievalVidore v1
nDCG@1091.9
11
Targeted Poisoning AttackViDoRe AI (Targeted Setting II: 5 queries, 1 answer) V1
ASR @1 (mean)88
10
GenerationViDoRe AI Targeted Setting III V1
ASR-G Sim^-1 (Mean)93
10
RetrievalViDoRe AI (Targeted Setting III) V1
ASR-R@1 (Mean)100
10
Document RetrievalViDoRe v2
NDCG@50.592
10
Visual Document RetrievalVidore V1 & V2
Avg. Acc84.87
10
Showing 25 of 34 rows