Moirai 2.0: When Less Is More for Time Series Forecasting
About
We introduce Moirai 2.0, a decoder-only time-series foundation model trained on a new corpus of 36M series. The model adopts quantile forecasting and multi-token prediction, improving both probabilistic accuracy and inference efficiency. On the Gift-Eval benchmark, it ranks among the top pretrained models while achieving a strong trade-off between accuracy, speed, and model size. Compared to Moirai 1.0, Moirai 2.0 replaces masked-encoder training, multi-patch inputs, and mixture-distribution outputs with a simpler decoder-only architecture, single patch, and quantile loss. Ablation studies isolate these changes -- showing that the decoder-only backbone along with recursive multi-quantile decoding contribute most to the gains. Additional experiments show that Moirai 2.0 outperforms larger models from the same family and exhibits robust domain-level results. In terms of efficiency and model size, Moirai 2.0 is twice as fast and thirty times smaller than its prior best version, Moirai 1.0-Large, while also performing better. Model performance plateaus with increasing parameter count and declines at longer horizons, motivating future work on data scaling and long-horizon modeling. We release code and evaluation details to support further research.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Time Series Forecasting | Weather | MSE0.0565 | 138 | |
| Time Series Forecasting | ETTh2 | MSE0.035 | 106 | |
| Time Series Forecasting | GIFT-Eval (test) | MASE72.8 | 63 | |
| Building IoT forecasting | LBNL59 (test) | nMAE0.578 | 40 | |
| Building IoT forecasting | BTS-C (test) | nMAE0.385 | 40 | |
| Building IoT forecasting | BTS-B (test) | nMAE0.391 | 40 | |
| Time Series Forecasting | 27 real-world application datasets (test) | SQL0.7139 | 36 | |
| Cold-start Photovoltaic Forecasting | 440 Photovoltaic Sites OPAQUE context (cold-start evaluation) | RMSE1.426 | 24 | |
| Cold-start Photovoltaic Forecasting | 440 Photovoltaic Sites PVGIS context (cold-start evaluation) | RMSE1.422 | 24 | |
| Photovoltaic Forecasting | OPAQUE context | MAE1.109 | 24 |