Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Sequential Image Hallucination Assessment on Mementos Object and Behavior
Loading...
48.15
Mementos Object Fidelity
SIMA
38.9356
41.3278
43.72
46.1122
May 24, 2024
Mementos Object Fidelity
Mementos Behavior Fidelity
Updated 4d ago
Evaluation Results
Method
Method
Links
Mementos Object Fidelity
Mementos Behavior Fidelity
SIMA
Base Model=VILA-7B
2024.05
48.15
27.04
SIMA
Base Model=LLaVA-1.5-7B
2024.05
46.08
26.03
SIMA
Base Model=LLaVA-1.5-13B
2024.05
45.84
27.17
GT-DPO
Base Model=VILA-7B
2024.05
44.25
26.91
GT-DPO
Base Model=LLaVA-1.5-7B
2024.05
43.67
24.35
POVID
Base Model=LLaVA-1.5-7B
2024.05
42.95
23.84
GT-DPO
Base Model=LLaVA-1.5-13B
2024.05
42.59
25.84
VILA-7B
Base Model=None
2024.05
41.96
25.88
HA-DPO
Base Model=LLaVA-1.5-7B
2024.05
41.07
23.58
RLHF
Base Model=LLaVA-1.5-7B
2024.05
40.53
22.71
LLaVA-1.5-13B
Base Model=None
2024.05
40.37
24.65
LLaVA-1.5-7B
Base Model=None
2024.05
39.29
23.02
Feedback
Search any
task
Search any
task
