Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Moirai 2.0: When Less Is More for Time Series Forecasting

About

We introduce Moirai 2.0, a decoder-only time-series foundation model trained on a new corpus of 36M series. The model adopts quantile forecasting and multi-token prediction, improving both probabilistic accuracy and inference efficiency. On the Gift-Eval benchmark, it ranks among the top pretrained models while achieving a strong trade-off between accuracy, speed, and model size. Compared to Moirai 1.0, Moirai 2.0 replaces masked-encoder training, multi-patch inputs, and mixture-distribution outputs with a simpler decoder-only architecture, single patch, and quantile loss. Ablation studies isolate these changes -- showing that the decoder-only backbone along with recursive multi-quantile decoding contribute most to the gains. Additional experiments show that Moirai 2.0 outperforms larger models from the same family and exhibits robust domain-level results. In terms of efficiency and model size, Moirai 2.0 is twice as fast and thirty times smaller than its prior best version, Moirai 1.0-Large, while also performing better. Model performance plateaus with increasing parameter count and declines at longer horizons, motivating future work on data scaling and long-horizon modeling. We release code and evaluation details to support further research.

Chenghao Liu, Taha Aksu, Juncheng Liu, Xu Liu, Hanshu Yan, Quang Pham, Silvio Savarese, Doyen Sahoo, Caiming Xiong, Junnan Li• 2025

Related benchmarks

TaskDatasetResultRank
Time Series ForecastingGIFT-Eval (test)
MASE72.8
63
Time Series Forecasting27 real-world application datasets (test)
SQL0.7139
36
Time Series ForecastingXAU/USD
MAE0.0062
18
Time Series ForecastingNDBC Wave-Height
MAE0.3545
18
Probabilistic time series forecastingENTSO-e Load FEV leaderboard subset 1H
SQL0.487
16
Probabilistic Univariate Time Series Forecastingfev-bench-uni
SQL0.5405
14
Time Series ForecastingPhotovoltaic datasets
SQL0.6175
14
Time Series ForecastingGIFT-Eval 97 tasks
MASE0.728
14
Time-series classification24 UCR/UEA datasets official (test)
Accuracy71.4
12
Timeseries ForecastingAngus Strawberry
MAE0.0161
12
Showing 10 of 19 rows

Other info

Follow for update