Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MMDocIR

Benchmarks

Task NameDataset NameSOTA ResultTrend
Page-level rerankingMMDocIR 1.0 (test)
Recall (Resolution)92.6
24
Page RetrievalMMDocIR 1.0 (full)
Macro R@164.7
15
Layout RetrievalMMDocIR 1.0 (full)
Macro Recall@139
13
Multimodal Document Information RetrievalMMDocIR (test)
Macro Recall@170.1
13
Multimodal Page-level RerankingMMDocIR v1 (test)
Recall@169.2
10
Scientific literature retrievalMMDocIR Scientific (test)
Recall@160
8
Multimodal RerankingMMDocIR (test)
Vision Latency (ms)180.2
5
Showing 7 of 7 rows