Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

CHAIR

Benchmarks

Task NameDataset NameSOTA ResultTrend
Hallucination EvaluationCHAIR
CHAIR_s72.8
166
Fine-Grained Sketch-Based Image Retrieval (FG-SBIR)Chair V2 (test)
Top-1 Accuracy89.69
72
Object Hallucination in Open-ended CaptioningCHAIR (test)
CHAIR_S62.3
50
Object Hallucination EvaluationCHAIR
CS Score57
49
Hallucination EvaluationCHAIR MSCOCO 2014 (val)
CHAIRi26.2
39
Hallucination MitigationCHAIR
CHAIR_S75
24
Object Hallucination EvaluationCHAIR MS COCO based (test)
CHAIRs56.2
18
Image CaptioningCHAIR
CHAIR_S31.3
16
Language Quality EvaluationCHAIR benchmark (test)
BLEU-119.2
16
Object Hallucination EvaluationCHAIR (val)
CHAIRs Score58.8
15
Object-level Composed RetrievalChair V2
Acc.@573.5
10
Sketch-to-Photo GenerationChair V2
FID90.21
8
Object Velocity TrackingChair
MAE vx (m/s)0.0409
7
Hallucination EvaluationCHAIR v1.0 (test)
CS52.93
6
3D Object CompletionChair (test)
Chamfer Distance (CD)20.3
6
Novel View SynthesisChair NeRF Blender (test)
PSNR34.92
6
Efficiency ComparisonCHAIR benchmark
Avg Time (s/caption)3.36
5
Text-to-3D GenerationChair
Metric-
0
Showing 18 of 18 rows