Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Moirai 2.0: When Less Is More for Time Series Forecasting

About

We introduce Moirai 2.0, a decoder-only time-series foundation model trained on a new corpus of 36M series. The model adopts quantile forecasting and multi-token prediction, improving both probabilistic accuracy and inference efficiency. On the Gift-Eval benchmark, it ranks among the top pretrained models while achieving a strong trade-off between accuracy, speed, and model size. Compared to Moirai 1.0, Moirai 2.0 replaces masked-encoder training, multi-patch inputs, and mixture-distribution outputs with a simpler decoder-only architecture, single patch, and quantile loss. Ablation studies isolate these changes -- showing that the decoder-only backbone along with recursive multi-quantile decoding contribute most to the gains. Additional experiments show that Moirai 2.0 outperforms larger models from the same family and exhibits robust domain-level results. In terms of efficiency and model size, Moirai 2.0 is twice as fast and thirty times smaller than its prior best version, Moirai 1.0-Large, while also performing better. Model performance plateaus with increasing parameter count and declines at longer horizons, motivating future work on data scaling and long-horizon modeling. We release code and evaluation details to support further research.

Chenghao Liu, Taha Aksu, Juncheng Liu, Xu Liu, Hanshu Yan, Quang Pham, Silvio Savarese, Doyen Sahoo, Caiming Xiong, Junnan Li• 2025

Related benchmarks

TaskDatasetResultRank
Time Series ForecastingGIFT-Eval (test)
MASE72.8
34
Probabilistic time series forecastingENTSO-e Load FEV leaderboard subset 1H
SQL0.487
16
Probabilistic time series forecastingENTSO-e Load FEV leaderboard 30T
SQL0.488
8
Probabilistic time series forecastingSolar with Weather FEV leaderboard 15T
SQL0.839
8
Probabilistic time series forecastingENTSO-e Load FEV leaderboard 15T
SQL0.478
8
Probabilistic time series forecastingGEOAVERAGE FEV leaderboard
SQL0.696
8
Probabilistic time series forecastingAVG RANK FEV leaderboard
SQL5.81
8
Probabilistic time series forecastingSolar with Weather FEV leaderboard 1H
SQL0.907
8
Showing 8 of 8 rows

Other info

Follow for update