Visual Commonsense Reasoning (Q->A) on VCR Shortcut Mitigated Evaluation SM (test)
76.32Q->A Accuracy (100%)
VILLA (MAD*) [ROBERTa/CLIP-V]
Updated 4d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| 76.32 | - | 41.98 | 56.85 | ||
2022.04 | 76.01 | - | 41.97 | 55.2 | |
2022.04 | 75.43 | - | 29.41 | 54.15 | |
2022.04 | 75.35 | 39.44 | - | 54.29 | |
2022.04 | 74.55 | 26.31 | 39.27 | - | |
2022.04 | 74.24 | 26.49 | 41.83 | 54.64 | |
2022.04 | 66.83 | 33.41 | - | 52.44 | |
2022.04 | 54.88 | - | - | 39.27 | |
2022.04 | 54.58 | - | 38.21 | - | |
2022.04 | 52.72 | 24.21 | 28.43 | - | |
2022.04 | 52.06 | 58.3 | - | 34.93 | |
2022.04 | 49.27 | 23.24 | 26.37 | - | |
2022.04 | 35.48 | - | 33.35 | 35.02 |