Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Mantis: A Foundation Model for Mechanistic Disease Forecasting

About

Infectious disease forecasting in novel outbreaks or low-resource settings is hampered by the need for large disease and covariate data sets, bespoke training, and expert tuning, all of which can hinder rapid generation of forecasts for new settings. To help address these challenges, we developed Mantis, a foundation model trained entirely on mechanistic simulations, which enables out-of-the-box forecasting across diseases, regions, and outcomes, even in settings with limited historical data. We evaluated Mantis against 78 forecasting models across sixteen diseases with diverse modes of transmission, assessing both point forecast accuracy (mean absolute error) and probabilistic performance (weighted interval score and coverage). Despite using no real-world data during training, Mantis achieved lower mean absolute error than all models in the CDC's COVID-19 Forecast Hub when backtested on early pandemic forecasts which it had not previously seen. Across all other diseases tested, Mantis consistently ranked in the top two models across evaluation metrics. Mantis further generalized to diseases with transmission mechanisms not represented in its training data, demonstrating that it can capture fundamental contagion dynamics rather than memorizing disease-specific patterns. These capabilities illustrate that purely simulation-based foundation models such as Mantis can provide a practical foundation for disease forecasting: general-purpose, accurate, and deployable where traditional models struggle.

Carson Dudley, Reiden Magdaleno, Christopher Harding, Ananya Sharma, Emily Martin, Marisa Eisenberg• 2025

Related benchmarks

TaskDatasetResultRank
Disease ForecastingState-level COVID-19
Relative MAE0.65
7
Disease ForecastingDengue cases
Relative WIS0.8
7
Disease ForecastingLocal-scale flu hosp.
Rel. MAE0.85
4
Disease ForecastingSmallpox cases
Relative MAE0.83
4
Disease ForecastingILI syndromic
Relative MAE0.83
4
Disease ForecastingScarlet Fever cases
Relative MAE0.8
4
Disease ForecastingDengue
MAE249.3
4
Disease ForecastingSmallpox
MAE21.4
4
Disease ForecastingFlu hosp.
MAE12.21
4
Disease ForecastingScarlet fever
Mean Absolute Error (MAE)72.31
4
Showing 10 of 22 rows

Other info

Follow for update