FI-KAN: Fractal Interpolation Kolmogorov-Arnold Networks
About
Kolmogorov-Arnold Networks (KAN) employ B-spline bases on a fixed grid, providing no intrinsic multi-scale decomposition for non-smooth function approximation. We introduce Fractal Interpolation KAN (FI-KAN), which incorporates learnable fractal interpolation function (FIF) bases from iterated function system (IFS) theory into KAN. Two variants are presented: Pure FI-KAN (Barnsley, 1986) replaces B-splines entirely with FIF bases; Hybrid FI-KAN (Navascues, 2005) retains the B-spline path and adds a learnable fractal correction. The IFS contraction parameters give each edge a differentiable fractal dimension that adapts to target regularity during training. On a Holder regularity benchmark ($\alpha \in [0.2, 2.0]$), Hybrid FI-KAN outperforms KAN at every regularity level (1.3x to 33x). On fractal targets, FI-KAN achieves up to 6.3x MSE reduction over KAN, maintaining 4.7x advantage at 5 dB SNR. On non-smooth PDE solutions (scikit-fem), Hybrid FI-KAN achieves up to 79x improvement on rough-coefficient diffusion and 3.5x on L-shaped domain corner singularities. Pure FI-KAN's complementary behavior, dominating on rough targets while underperforming on smooth ones, provides controlled evidence that basis geometry must match target regularity. A fractal dimension regularizer provides interpretable complexity control whose learned values recover the true fractal dimension of each target. These results establish regularity-matched basis design as a principled strategy for neural function approximation.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| 1D Regression | polynomial 1D function (test) | Test MSE1.30e-5 | 6 | |
| 1D Regression | exp_sin 1D function (test) | Test MSE7.00e-6 | 6 | |
| 1D Regression | chirp 1D function (test) | Test MSE0.157 | 6 | |
| 1D Regression | weierstrass_std 1D function (test) | Test MSE0.0438 | 6 | |
| 1D Regression | weierstrass_rough 1D function (test) | Test MSE0.0931 | 6 | |
| 1D Regression | sawtooth 1D function (test) | Test MSE0.0018 | 6 | |
| 1D Regression | multiscale 1D function (test) | Test MSE0.0016 | 6 | |
| Function Approximation | KAN Paper Toy Functions 10D sum | Mean Squared Error (MSE)4.03e-4 | 6 | |
| Function Approximation | KAN Paper Toy Functions J0 Bessel | Mean Squared Error (MSE)2.18e-4 | 6 | |
| Function Approximation | KAN Paper Toy Functions e^x sin(y) + y^2 | Mean MSE0.0616 | 6 |