| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| VCR Shortcut Mitigated Evaluation SM (test) | VILLA (MAD*) [ROBERTa/CLIP-V] | Q->A Accuracy (100%)76.32 | 13 | 1mo ago | |
| VCR Standard Evaluation (test) | VILLA (MAD*) [ROBERTa/CLIP-V] | Q->A Accuracy (3%, 1000 SP/C)61.49 | 13 | 1mo ago | |
| VCR (val) | MERLOT | Accuracy79.4 | 8 | 1mo ago |