MM-A
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Image Classification | MM-A out-of-distribution (OOD) | Task Accuracy90 | 6 | |
| Image Classification | MM-A in-distribution (test) | Accuracy98.9 | 6 | |
| Image Classification | MM-A Extrapolation 5 digits | Task Accuracy44.06 | 5 | |
| Image Classification | MM-A Extrapolation 4 digits | Task Accuracy69.73 | 5 | |
| Object-level Decomposition | MM-A (out-of-distribution) | Concept Accuracy65.46 | 2 | |
| Object-level Decomposition | MM-A in-distribution (test) | Concept Accuracy85.16 | 2 |
Showing 6 of 6 rows