Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Looped SSMs: Depth-Recurrence and Input Reshaping for Time Series Classification

About

State Space Models (SSMs) are inherently recurrent along the sequence dimension, yet depth-recurrence - reusing the same block repeatedly across layers, as recently applied in looped transformers - has not been explored in this model family. We show that a looped SSM with $k$ parameters iterated $L$ times consistently closely matches or outperforms a standard SSM with $k \cdot L$ independent parameters across four architectures (LRU, S5, LinOSS, LrcSSM) and six time series classification benchmarks, despite operating within a strictly smaller hypothesis space, as we formally establish. Since the larger model contains the looped model as a special case, this dominance cannot be explained by expressivity and instead points to parameter sharing across depth as a beneficial inductive bias that simplifies optimization. These results demonstrate that depth-recurrence is orthogonal to sequence-recurrence and independently beneficial. We further show that input reshaping is an equally neglected design axis: concatenating timesteps for low-dimensional inputs, or flattening and rechunking the joint feature-time dimension for high-dimensional ones, yields accuracy gains of 1-6% across all models, confirmed over 5 random seeds. Both techniques provide standalone improvements that compound when combined, suggesting that depth and input reshaping are two independent and underexplored design axes for SSMs on time series.

M\'onika Farsang, Ramin Hasani, Daniela Rus, Radu Grosu• 2026

Related benchmarks

TaskDatasetResultRank
Time-series classificationSelfRegulationSCP2
Accuracy57.89
148
Time-series classificationHeartbeat
Accuracy78.33
131
Time-series classificationSelfRegulationSCP1
Accuracy90.12
123
Time-series classificationWorms
Accuracy95.83
56
Time-series classificationEthanol
Accuracy37.63
56
Time-series classificationMotor
Accuracy60.71
56
Showing 6 of 6 rows

Other info

Follow for update