CHAIR
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Hallucination Evaluation | CHAIR | CHAIR_s72.8 | 252 | |
| Object Hallucination Evaluation | CHAIR | CS Score59.4 | 108 | |
| Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) | Chair V2 (test) | Top-1 Accuracy89.69 | 72 | |
| Hallucination Evaluation | CHAIR MSCOCO | CHAIR_S59.4 | 64 | |
| Object Hallucination Evaluation | CHAIR MSCOCO v1.0 (val) | CHAIRs54.6 | 51 | |
| Object Hallucination in Open-ended Captioning | CHAIR (test) | CHAIR_S62.3 | 50 | |
| Hallucination Evaluation | CHAIR MSCOCO 2014 (val) | CHAIRi26.2 | 39 | |
| Hallucination Evaluation | CHAIR MSCOCO 2014 | CHAIRs Score51.3 | 28 | |
| Hallucination Mitigation | CHAIR | CHAIR_S75 | 24 | |
| Object Hallucination Mitigation | CHAIR | CHAIRs Score69.8 | 22 | |
| Image Captioning | CHAIR (test) | Cs Score52.6 | 22 | |
| Image Captioning | CHAIR | CHAIR_S58.6 | 22 | |
| Caption Hallucination Evaluation | CHAIR | CS Score53 | 20 | |
| Object Hallucination Evaluation | CHAIR MS COCO based (test) | CHAIRs56.2 | 18 | |
| Hallucination Evaluation | CHAIR (val) | CHAIRs59.5 | 16 | |
| Language Quality Evaluation | CHAIR benchmark (test) | BLEU-119.2 | 16 | |
| Object Hallucination Evaluation | CHAIR (val) | CHAIRs Score58.8 | 15 | |
| Caption Hallucination Assessment | CHAIR Zoom Blur (val) | CHAIRS Score59.8 | 14 | |
| Object-level Composed Retrieval | Chair V2 | Acc.@573.5 | 10 | |
| Object Hallucination Assessment | CHAIR (test) | CS (%)58.2 | 9 | |
| Hallucination Evaluation | CHAIR instance-level (test) | Brightness11.7 | 8 | |
| Sketch-to-Photo Generation | Chair V2 | FID90.21 | 8 | |
| Object Velocity Tracking | Chair | MAE vx (m/s)0.0409 | 7 | |
| Hallucination Evaluation | CHAIR v1.0 (test) | CS52.93 | 6 | |
| 3D Object Completion | Chair (test) | Chamfer Distance (CD)20.3 | 6 |
Showing 25 of 28 rows