Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Multimodal Understanding on MMStar (5% Forget Set)
Loading...
49.27
Average Score
Vanilla
29.0524
34.3012
39.55
44.7988
Feb 21, 2025
Average Score
Updated 4d ago
Evaluation Results
Method
Method
Links
Average Score
Vanilla
Base Model=Idefics2, F...
2025.02
49.27
MANU
Base Model=Idefics2, F...
2025.02
44.71
NPO
Base Model=Idefics2, F...
2025.02
42.88
KL Minim.
Base Model=Idefics2, F...
2025.02
41.09
Grad. Diff
Base Model=Idefics2, F...
2025.02
41.02
GA
Base Model=Idefics2, F...
2025.02
40.9
Vanilla
Base Model=LLaVA, Forg...
2025.02
34.8
MANU
Base Model=LLaVA, Forg...
2025.02
32.41
NPO
Base Model=LLaVA, Forg...
2025.02
32.32
KL Minim.
Base Model=LLaVA, Forg...
2025.02
31.29
Grad. Diff
Base Model=LLaVA, Forg...
2025.02
30.13
GA
Base Model=LLaVA, Forg...
2025.02
29.83
Feedback
Search any
task
Search any
task