Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Sequential Image Hallucination Assessment on Mementos Object and Behavior
Loading...
48.15
Mementos Object Fidelity
SIMA
38.9356
41.3278
43.72
46.1122
May 24, 2024
Mementos Object Fidelity
Mementos Behavior Fidelity
Updated 1mo ago
Evaluation Results
Method
Method
Links
Mementos Object Fidelity
Mementos Behavior Fidelity
SIMA
Base Model=VILA-7B
2024.05
48.15
27.04
SIMA
Base Model=LLaVA-1.5-7B
2024.05
46.08
26.03
SIMA
Base Model=LLaVA-1.5-13B
2024.05
45.84
27.17
GT-DPO
Base Model=VILA-7B
2024.05
44.25
26.91
GT-DPO
Base Model=LLaVA-1.5-7B
2024.05
43.67
24.35
POVID
Base Model=LLaVA-1.5-7B
2024.05
42.95
23.84
GT-DPO
Base Model=LLaVA-1.5-13B
2024.05
42.59
25.84
VILA-7B
Base Model=None
2024.05
41.96
25.88
HA-DPO
Base Model=LLaVA-1.5-7B
2024.05
41.07
23.58
RLHF
Base Model=LLaVA-1.5-7B
2024.05
40.53
22.71
LLaVA-1.5-13B
Base Model=None
2024.05
40.37
24.65
LLaVA-1.5-7B
Base Model=None
2024.05
39.29
23.02
Feedback
Search any
task
Search any
task
