Spectral Path Regression: Directional Chebyshev Harmonics for Interpretable Tabular Learning
About
Classical approximation bases such as Chebyshev polynomials provide principled and interpretable representations, but their multivariate tensor-product constructions scale exponentially with dimension and impose axis-aligned structure that is poorly matched to real tabular data. We address this by replacing tensorised oscillations with directional harmonic modes of the form $\cos(\mathbf{m}^{\top}\arccos(\mathbf{x}))$, which organise multivariate structure by direction in angular space rather than by coordinate index. This representation yields a discrete spectral regression model in which complexity is controlled by selecting a small number of structured frequency vectors (spectral paths), and training reduces to a single closed-form ridge solve with no iterative optimisation. Experiments on standard continuous-feature tabular regression benchmarks show that the resulting models achieve accuracy competitive with strong nonlinear baselines while remaining compact, computationally efficient, and explicitly interpretable through analytic expressions of learned feature interactions.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Tabular Regression | Energy Cooling UCI | Total experiment time (s)0.4 | 4 | |
| Tabular Regression | Concrete Slump OpenML | Total experiment time (s)0.4 | 4 | |
| Tabular Regression | Yacht Hydrodynamics OpenML | Total Experiment Time (s)0.1 | 4 | |
| Tabular Regression | Cancer Drug Response OpenML | Total Time (s)1.4 | 4 | |
| Tabular Regression | Ankara Weather OpenML | Total experiment time (s)0.1 | 4 | |
| Tabular Regression | Concrete (UCI) | Total Experiment Time (s)1 | 4 | |
| Tabular Regression | Energy Heating (UCI) | Total Experiment Time (s)0.4 | 4 | |
| Tabular Regression | Wine Quality (UCI) | Total experiment time (s)4.4 | 4 | |
| Tabular Regression | Phishing Websites (UCI) | Total Experiment Time (s)5.5 | 4 | |
| Tabular Regression | Aquatic Toxicity OpenML | Total Experiment Time (s)0.2 | 4 |