SIQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Commonsense Reasoning | SIQA | Accuracy89.85 | 183 | |
| Social Interaction Question Answering | SIQA | Accuracy86.9 | 157 | |
| Social Commonsense Reasoning | SIQA | Accuracy86.9 | 118 | |
| Reasoning | SIQA | Accuracy83.2 | 44 | |
| Commonsense Reasoning | SIQA (test) | Accuracy57 | 22 | |
| Social Commonsense Reasoning | SIQA (test) | Accuracy83.3 | 20 | |
| Social Commonsense Question Answering | SIQA | Accuracy80.04 | 14 | |
| Scientific Image Quality Assessment Understanding | SIQA-U | Scientific Completeness60.5 | 14 | |
| Zero-shot Common Sense Reasoning | SIQA | Accuracy (Zero-shot)41.91 | 12 | |
| Reasoning | SIQA (leave-one-out setup) | Average Accuracy82.4 | 12 | |
| Scientific Image Quality Assessment | SIQA-S 1.0 (test) | Perception SRCC0.857 | 12 | |
| Reasoning | SIQA | Accuracy Improvement2.12 | 12 | |
| Reading Comprehension | SIQA | Normalized Accuracy41.66 | 11 | |
| Social Interaction Question Answering | SIQA | Normalized PLL Score50.4 | 10 | |
| Reasoning | SIQA (val) | Accuracy35.47 | 9 | |
| Question Answering | SIQA (test) | Accuracy94.06 | 7 | |
| Scaling Law Fitting | SiQA | Score at Scaling Factor 1e-50.987 | 7 | |
| Reward Prediction | SIQA (out-of-domain) | Accuracy76.89 | 6 | |
| Social Reasoning | SIQA | Performance (%)15.2 | 6 |
Showing 19 of 19 rows