Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Permutation-Equivariant 2D State Space Models: Theory and Canonical Architecture for Multivariate Time Series

About

Multivariate time series (MTS) modeling often implicitly imposes an artificial ordering over variables, violating the inherent exchangeability found in many real-world systems where no canonical variable axis exists. We formalize this limitation as a violation of the permutation symmetry principle and require state-space dynamics to be permutation-equivariant along the variable axis. In this work, we theoretically characterize the complete canonical form of linear variable coupling under this symmetry constraint. We prove that any permutation-equivariant linear 2D state-space system naturally decomposes into local self-dynamics and a global pooled interaction, rendering ordered recurrence not only unnecessary but structurally suboptimal. Motivated by this theoretical foundation, we introduce the Variable-Invariant Two-Dimensional State Space Model (VI 2D SSM), which realizes the canonical equivariant form via permutation-invariant aggregation. This formulation eliminates sequential dependency chains along the variable axis, reducing the dependency depth from $\mathcal{O}(C)$ to $\mathcal{O}(1)$ and simplifying stability analysis to two scalar modes. Furthermore, we propose VI 2D Mamba, a unified architecture integrating multi-scale temporal dynamics and spectral representations. Extensive experiments on forecasting, classification, and anomaly detection benchmarks demonstrate that our model achieves state-of-the-art performance with superior structural scalability, validating the theoretical necessity of symmetry-preserving 2D modeling.

Seungwoo Jeong, Heung-Il Suk• 2026

Related benchmarks

TaskDatasetResultRank
Long-term time-series forecastingWeather
MSE0.15
448
Long-term time-series forecastingETTh1
MAE0.394
446
Long-term time-series forecastingTraffic
MSE0.369
362
Anomaly DetectionSMD
F1 Score83.74
359
Long-term time-series forecastingETTh2
MSE0.257
353
Long-term time-series forecastingETTm1
MSE0.287
334
Long-term time-series forecastingETTm2
MSE0.169
330
Anomaly DetectionSWaT
F1 Score93.94
276
Long-term time-series forecastingECL
MSE0.127
154
Anomaly DetectionPSM
F1 Score97.42
142
Showing 10 of 29 rows

Other info

Follow for update