LArctan-SKAN: Simple and Efficient Single-Parameterized Kolmogorov-Arnold Networks using Learnable Trigonometric Function
About
This paper proposes a novel approach for designing Single-Parameterized Kolmogorov-Arnold Networks (SKAN) by utilizing a Single-Parameterized Function (SFunc) constructed from trigonometric functions. Three new SKAN variants are developed: LSin-SKAN, LCos-SKAN, and LArctan-SKAN. Experimental validation on the MNIST dataset demonstrates that LArctan-SKAN excels in both accuracy and computational efficiency. Specifically, LArctan-SKAN significantly improves test set accuracy over existing models, outperforming all pure KAN variants compared, including FourierKAN, LSS-SKAN, and Spl-KAN. It also surpasses mixed MLP-based models such as MLP+rKAN and MLP+fKAN in accuracy. Furthermore, LArctan-SKAN exhibits remarkable computational efficiency, with a training speed increase of 535.01% and 49.55% compared to MLP+rKAN and MLP+fKAN, respectively. These results confirm the effectiveness and potential of SKANs constructed with trigonometric functions. The experiment code is available at https://github.com/chikkkit/LArctan-SKAN .
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Human Activity Recognition | PAMAP2 | -- | 54 | |
| Human Activity Recognition | Opportunity | Macro F140.8 | 43 | |
| Activity Recognition | mHealth | -- | 35 | |
| Human Activity Recognition | MotionSense | Macro-F183.7 | 29 | |
| Human Activity Recognition | SKODA | Macro F183.4 | 29 | |
| Activity Recognition | DSADS | Macro F154.3 | 20 | |
| Human Activity Recognition | HAPT | Macro-F169.8 | 20 | |
| Activity Recognition | DG | Macro F1 Score58.4 | 20 |