MMRel
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Action-relation hallucination evaluation | MMRel DALL-E | Accuracy75.23 | 25 | |
| Action-relation hallucination evaluation | MMRel Real | Accuracy78.56 | 25 | |
| Multimodal Relation Reasoning | MMRel | Accuracy75.21 | 20 | |
| Open-ended action-relation hallucination evaluation | MMRel DALL-E | Score7.47 | 8 | |
| Open-ended action-relation hallucination evaluation | MMRel Real | Score8.26 | 8 | |
| Spatial-relation hallucination detection | MMRel DALL-E | Accuracy55.37 | 8 | |
| Spatial-relation hallucination detection | MMRel Real image | Accuracy57.35 | 8 |
Showing 7 of 7 rows