Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Multimodal Reranking Performance on MMDocIR (test)
Loading...
180.2
Vision Latency (ms)
ZipRerank
152.48
339.59
526.7
713.81
May 12, 2026
Vision Latency (ms)
Filter Latency (ms)
LLM Latency (ms)
Total Latency (ms)
TFLOPs per Query
Cached Queries Per Second (QPS)
Peak GPU Memory Usage (GB)
Updated 21d ago
Evaluation Results
Method
Method
Links
Vision Latency (ms)
Filter Latency (ms)
LLM Latency (ms)
Total Latency (ms)
TFLOPs per Query
Cached Queries Per Second (QPS)
Peak GPU Memory Usage (GB)
ZipRerank
Scoring Strategy=Listw...
2026.05
180.2
4.5
269.4
454.1
84.9
3.65
20.05
ZipRerank
Scoring Strategy=Listwise
2026.05
181.2
-
357.4
538.5
179.7
2.8
21.71
LamRA
Scoring Strategy=Listwise
2026.05
352.7
-
529.3
881.9
368.2
1.89
28.31
DocReRank
Scoring Strategy=Point...
2026.05
401.1
-
737.8
1,140.8
54.8
1.35
4.54
MM-R5
Scoring Strategy=Listwise
2026.05
873.2
-
3,233.8
4,107
263.2
0.31
23.04
Feedback
Search any
task
Search any
task
