Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Adaptive Normalization Mamba with Multi Scale Trend Decomposition and Patch MoE Encoding

About

Time series forecasting in real world environments faces significant challenges non stationarity, multi scale temporal patterns, and distributional shifts that degrade model stability and accuracy. This study propose AdaMamba, a unified forecasting architecture that integrates adaptive normalization, multi scale trend extraction, and contextual sequence modeling to address these challenges. AdaMamba begins with an Adaptive Normalization Block that removes non stationary components through multi scale convolutional trend extraction and channel wise recalibration, enabling consistent detrending and variance stabilization. The normalized sequence is then processed by a Context Encoder that combines patch wise embeddings, positional encoding, and a Mamba enhanced Transformer layer with a mixture of experts feed forward module, allowing efficient modeling of both long range dependencies and local temporal dynamics. A lightweight prediction head generates multi horizon forecasts, and a denormalization mechanism reconstructs outputs by reintegrating local trends to ensure robustness under varying temporal conditions. AdaMamba provides strong representational capacity with modular extensibility, supporting deterministic prediction and compatibility with probabilistic extensions. Its design effectively mitigates covariate shift and enhances predictive reliability across heterogeneous datasets. Experimental evaluations demonstrate that AdaMamba's combination of adaptive normalization and expert augmented contextual modeling yields consistent improvements in stability and accuracy over conventional Transformer based baselines.

MinCheol Jeon• 2025

Related benchmarks

TaskDatasetResultRank
Multivariate long-term forecastingETTh1
MSE0.4419
344
Multivariate long-term series forecastingETTh2
MSE0.3722
319
Multivariate long-term series forecastingETTm1
MSE0.3788
257
Multivariate long-term time series forecastingWeather
MSE0.2538
74
Multivariate long-term time series forecastingETTm2
MSE0.2825
74
Showing 5 of 5 rows

Other info

Follow for update