HallusionBench

Benchmarks

Task Name	Dataset Name	SOTA Result
Visual Hallucination Evaluation	HallusionBench	Accuracy76.6	156
Hallucination Evaluation	HallusionBench	Accuracy82.02	153
Hallucination and Visual Reasoning Evaluation	HallusionBench	Accuracy (aACC)81.8	61
Visual Reasoning	HallusionBench	Accuracy73.2	43
Multimodal Reasoning	HallusionBench	Accuracy0.7293	42
Hallucination Assessment	HallusionBench	Answer Accuracy (aAcc)71.6	39
Multimodal Understanding	HallusionBench	Accuracy77.2	37
Hallucination Robustness	HallusionBench	Score58.4	37
Hallucination	HallusionBench	HallusionBench Score69.2	26
Visual Perception	HallusionBench	Accuracy71.08	24
Multimodal Hallucination Evaluation	HallusionBench	Hallucination Score70.7	22
Hallucination Mitigation	HallusionBench visual-dependent setting (test)	qAcc (Question Accuracy)33.21	21
Multimodal Hallucination Assessment	HallusionBench	Accuracy70	21
Hallucination Detection	HallusionBench	Hallusion Score67.05	20
General VQA	HallusionBench	Accuracy73.48	20
Visual Question Answering	HallusionBench	Simple Accuracy75.2	19
Hallucination	HallusionBench	Pass@174	16
Hallucination Diagnosis	HallusionBench	LI Score96	15
Perception	HallusionBench	Score59.5	15
General visual question answering	HallusionBench	Pass@169.9	14
Hallucination Evaluation	HallusionBench 2024	Score52.2	13
Visual Illusion and Hallucination Evaluation	HallusionBench (HallB)	HallB Score41.7	13
MM Alignment	HallusionBench	Score67.9	12
Hallucination and Visual Illusion Assessment	HallusionBench	Accuracy22.51	12
Hallucination Evaluation	HallusionBench GPT4-assisted (All)	Accuracy (All)49.94	11

Showing 25 of 41 rows