In-distribution
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Harmfulness Detection | Full in-distribution (test) | AUROC0.964 | 63 | |
| Error Detection | In-distribution (test) | AUC0.8916 | 40 | |
| Mathematical Reasoning | In-Distribution Avg | Average Score45.6 | 29 | |
| Debiasing Effectiveness | In-Distribution (ID) | Mean Effectiveness Score (ID)10.2 | 16 | |
| Object type prediction | In-Distribution (ID) | Accuracy (ID)100 | 9 | |
| Reasoning step reduction | In-Distribution 5K corpus (test) | Savings Rate47.5 | 9 | |
| Point Tracking | In-distribution | Avg Displacement Error57.4 | 6 | |
| Prompt Injection Detection | In-distribution (ID) (test) | Macro F1 Score95.41 | 5 | |
| Text-to-Speech | In-distribution ID (test) | MOS3.87 | 5 | |
| Metasurface inverse design | In-Distribution (test) | SG74 | 2 |
Showing 10 of 10 rows