Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Long multimodal document understanding on MM-NIAH
Loading...
46.1
Overall Score
InternVL1.5-RAG
7.308
17.379
27.45
37.521
Oct 8, 2024
Overall Score
Performance (1K Context)
Performance (4K Context)
Performance (16K Context)
Performance (64K Context)
Updated 1mo ago
Evaluation Results
Method
Method
Links
Overall Score
Performance (1K Context)
Performance (4K Context)
Performance (16K Context)
Performance (64K Context)
InternVL1.5-RAG
#param=45B, zero-shot=...
2024.10
46.1
59.5
50.1
44.9
39.3
PDF-WuKong
#param=8.5B, zero-shot...
2024.10
43.3
53
43.9
43
42.1
InternVL1.5
#param=26B, zero-shot=...
2024.10
41.1
59.5
50.1
41.9
16.6
llava-v1.6-34b
#param=34B, zero-shot=...
2024.10
20.6
57.4
45.1
8.2
0
llava-v1.6-13b
#param=13B, zero-shot=...
2024.10
16.9
43.7
34.9
13.6
0
VILA1.0-13b
#param=13B, zero-shot=...
2024.10
15.7
41.9
33.2
8.6
0.1
Emu2-Chat
#param=37B, zero-shot=...
2024.10
8.8
38.9
18.2
0
0
Feedback
Search any
task
Search any
task