Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Multimodal on MMMU Pro (test)
Loading...
54.43
Success Rate
MemQ
48.2212
49.8331
51.445
53.0569
May 8, 2026
Success Rate
Updated 22d ago
Evaluation Results
Method
Method
Links
Success Rate
MemQ
Model=Gemma-4-E4B-it
2026.05
54.43
MemP
Model=Gemma-4-E4B-it
2026.05
54.24
RAG
Model=Gemma-4-E4B-it
2026.05
53.76
MemRL
Model=Gemma-4-E4B-it
2026.05
53.66
Self-RAG
Model=Gemma-4-E4B-it
2026.05
53.57
Mem0
Model=Gemma-4-E4B-it
2026.05
49.9
No Mem.
Model=Gemma-4-E4B-it
2026.05
48.46
Feedback
Search any
task
Search any
task
