Synth
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Relative Depth Estimation | Synth4K-5 | Delta Threshold Accuracy (0.5)88.5 | 16 | |
| Relative Depth Estimation | Synth4K-3 | Acc (delta=0.5)82 | 16 | |
| Graph Classification | Synth (basis+std, r = 1) OOD | Accuracy61 | 14 | |
| Graph Classification | Synth basis+std r = 1 ID | Accuracy62.5 | 14 | |
| Graph-level classification | SYNTH | MCC1 | 14 | |
| Time Series Forecasting | Synth-12 sigma=0.9 | MSE0.36 | 12 | |
| Time Series Forecasting | Synth sigma=0.7 12-variable synthetic | MSE0.379 | 12 | |
| Time Series Forecasting | Synth-12 sigma=0.5 synthetic | MSE0.391 | 12 | |
| Time Series Forecasting | Synth synthetic sigma=0.3 12-variable | MSE0.378 | 12 | |
| Time Series Forecasting | Synth 12-variable synthetic (sigma=0.1) | MSE0.386 | 12 | |
| Question Answering | SYNTH | Accuracy86.9 | 12 | |
| Graph Classification | SYNTH | Accuracy100 | 8 | |
| Average Treatment Effect Estimation | Synth | Latency (s)0.02 | 7 | |
| ATE Estimation | Synth | Memory Consumption (MB)468.29 | 7 | |
| Molecular optimization | SYNTH | Yield7,371,212 | 4 | |
| Multi-talker Automatic Speech Recognition | Synth (test) | tcpWER9.6 | 3 | |
| Text Recognition | Synth | Accuracy95.2 | 1 |
Showing 17 of 17 rows