Deep Single-Index Fr\'echet Regression
About
Predicting outputs that are located in non-Euclidean spaces, such as probability distributions, networks, and symmetric positive-definite matrices, is becoming increasingly important in modern data analysis, particularly when inputs are high-dimensional. We propose DeSI (Deep Single-Index Fr\'echet Regression), a semiparametric framework for regression with metric space-valued outputs and multivariate inputs that assumes a single-index structure for the conditional Fr\'echet mean. DeSI estimates an interpretable index direction, which quantifies the relative importance of inputs, using a deep neural network, and performs Fr\'echet regression along the resulting one-dimensional index in the target metric space. This structure mitigates the curse of dimensionality while retaining interpretability, which stands in contrast to standard deep neural networks. We establish theoretical guarantees for DeSI, including uniform approximation and convergence rates, and demonstrate its strong predictive performance through simulations on distributions, networks, and symmetric positive-definite matrices, as well as an application to compositional mood data from New Jersey.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Fréchet Regression | Networks | Mean Prediction Error0.0531 | 12 | |
| Fréchet Regression | Probability Distributions Linear | Mean Prediction Error0.0344 | 12 | |
| Fréchet Regression | Probability Distributions Quadratic | Mean Prediction Error0.0892 | 12 | |
| Fréchet Regression | Probability Distributions Exponential | Mean Prediction Error0.069 | 12 | |
| Fréchet Regression | SPD (Symmetric Positive Definite matrices) | Mean Prediction Error0.0057 | 9 | |
| Compositional mood prediction | New Jersey compositional mood data | MPE0.4658 | 3 |