Synthetic Data
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Conformal Prediction | 5-class synthetic data Example 1 Hard Bin r* ≤ 0.5 | Coverage93.4 | 97 | |
| Conformal Prediction | 5-class synthetic data Example 1 Marginal | Coverage92.3 | 97 | |
| Conformal Prediction | 5-class Synthetic Data Example 2 covariate shift a=0.5 Marginal | Coverage92 | 75 | |
| Sequence Reconstruction | Synthetic data L = 110 | Levenshtein Distance0.175 | 72 | |
| Tree Explainer Runtime and Stability Analysis | Synthetic data d=100 | Runtime (ms)0.006 | 72 | |
| Causal Discovery | Synthetic Data | Runtime0 | 57 | |
| Average treatment effect estimation | Synthetic Data | Averaged MSE0.176 | 54 | |
| Conformal Prediction | 5-class synthetic data (Example 1) Easy Bin (r* > 0.5) 1.0 (test) | Coverage99.7 | 52 | |
| Conformal Prediction | 5-class synthetic data Example 1, Easy Bin r* > 0.5 | Coverage99.7 | 45 | |
| Time Series Prediction | Synthetic Data 5 systems | RMSE0.24 | 39 | |
| Equilibrium State Estimation | Synthetic data | Cost (5 Systems, mins)0.04 | 39 | |
| Multivariate distribution estimation | Synthetic Data I | ED0.023 | 35 | |
| Prediction Region Estimation | Synthetic data 100 seeds (test) | Coverage99.017 | 32 | |
| Conformal Prediction | 5-class synthetic data Easy Bin, r* > 0.5 | Coverage99.7 | 30 | |
| Conformal Prediction | 5-class synthetic data Hard Bin, r* <= 0.5 | Coverage92.8 | 30 | |
| Conformal Prediction | 5-class synthetic data Marginal | Coverage92.3 | 30 | |
| Conformal Prediction | synthetic data 5-class Example 2 covariate shift a=0.5 Easy Bin (r* > 0.5) | Coverage96.6 | 30 | |
| Conformal Prediction | 5-class synthetic data Example 2 covariate shift a=0.5 Hard Bin (r* <= 0.5) | Coverage85.6 | 30 | |
| Tensor Decomposition | Synthetic Data (Tucker) | Completeness Ratio (CR)10.7 | 30 | |
| Tree Explainer Runtime and Stability Analysis | Synthetic data d=10 | Runtime (ms)0.005 | 29 | |
| Causal Discovery | Synthetic Data |V|=5 | NSHD0.21 | 24 | |
| Tool Use | Synthetic Data (test) | Task Accuracy92.29 | 24 | |
| Symbolic Reconstruction | Synthetic Data Interact Mode (test) | Reconstruction Accuracy108.04 | 20 | |
| Canonical Correlation Analysis | Synthetic Data | Aggregate Disparity (Delta_sum,r)2.2304 | 20 | |
| 3D Shape Completion | Synthetic data (test) | Chamfer Distance (CD)0.61 | 19 |
Showing 25 of 233 rows
...