Mantis: A Foundation Model for Mechanistic Disease Forecasting
About
Infectious disease forecasting in novel outbreaks or low-resource settings is hampered by the need for large disease and covariate data sets, bespoke training, and expert tuning, all of which can hinder rapid generation of forecasts for new settings. To help address these challenges, we developed Mantis, a foundation model trained entirely on mechanistic simulations, which enables out-of-the-box forecasting across diseases, regions, and outcomes, even in settings with limited historical data. We evaluated Mantis against 78 forecasting models across sixteen diseases with diverse modes of transmission, assessing both point forecast accuracy (mean absolute error) and probabilistic performance (weighted interval score and coverage). Despite using no real-world data during training, Mantis achieved lower mean absolute error than all models in the CDC's COVID-19 Forecast Hub when backtested on early pandemic forecasts which it had not previously seen. Across all other diseases tested, Mantis consistently ranked in the top two models across evaluation metrics. Mantis further generalized to diseases with transmission mechanisms not represented in its training data, demonstrating that it can capture fundamental contagion dynamics rather than memorizing disease-specific patterns. These capabilities illustrate that purely simulation-based foundation models such as Mantis can provide a practical foundation for disease forecasting: general-purpose, accurate, and deployable where traditional models struggle.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Disease Forecasting | State-level COVID-19 | Relative MAE0.65 | 7 | |
| Disease Forecasting | Dengue cases | Relative WIS0.8 | 7 | |
| Disease Forecasting | Local-scale flu hosp. | Rel. MAE0.85 | 4 | |
| Disease Forecasting | Smallpox cases | Relative MAE0.83 | 4 | |
| Disease Forecasting | ILI syndromic | Relative MAE0.83 | 4 | |
| Disease Forecasting | Scarlet Fever cases | Relative MAE0.8 | 4 | |
| Disease Forecasting | Dengue | MAE249.3 | 4 | |
| Disease Forecasting | Smallpox | MAE21.4 | 4 | |
| Disease Forecasting | Flu hosp. | MAE12.21 | 4 | |
| Disease Forecasting | Scarlet fever | Mean Absolute Error (MAE)72.31 | 4 |