Spriteworld
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Property Comparison | Spriteworld unseen object numbers (test) | Avg Success Rate91.1 | 9 | |
| Object Comparison | Spriteworld unseen object numbers (test) | Avg Success Rate90.4 | 9 | |
| Object Interaction | Spriteworld unseen object numbers (test) | Avg Success Rate90 | 9 | |
| Object Goal | Spriteworld unseen object numbers (test) | Success Rate92.8 | 9 | |
| Property Comparison | Spriteworld | Success Rate90.7 | 9 | |
| Object Comparison | Spriteworld | Success Rate89.3 | 9 | |
| Object Interaction | Spriteworld | Success Rate89 | 9 | |
| Object Goal | Spriteworld | Success Rate89.7 | 9 | |
| Property Comparison | Spriteworld (train) | Success Rate93 | 9 | |
| Object Comparison | Spriteworld (train) | Success Rate92.3 | 9 | |
| Object Interaction | Spriteworld (train) | Success Rate93.1 | 9 | |
| Object Goal | Spriteworld (train) | Success Rate92.5 | 9 | |
| Property Comparison | Spriteworld unseen object colors and shapes (test) | Metric- | 0 | |
| Object Comparison | Spriteworld unseen object colors and shapes (test) | Metric- | 0 | |
| Object Interaction | Spriteworld unseen object colors and shapes (test) | Metric- | 0 | |
| Object Goal | Spriteworld unseen object colors and shapes (test) | Metric- | 0 |
Showing 16 of 16 rows