Achieving Time Series Reasoning Requires Rethinking Model Design, Tasks Formulation, and Evaluation
About
Understanding time series data is fundamental to many real-world applications. Recent work explores multimodal large language models (MLLMs) to enhance time series understanding with contextual information beyond numerical signals. This area has grown from 7 papers in 2023 to over 580 in 2025, yet existing methods struggle in real-world settings. We analyze 20 influential works from 2025 across model design, task formulation, and evaluation, and identify critical gaps: methods adapt NLP techniques with limited attention to core time series properties; tasks remain restricted to traditional prediction and classification; and evaluations emphasize benchmarks over robustness, interpretability, or decision relevance. We argue that achieving time series reasoning requires rethinking model design, task formulation, and evaluation together. We define time series reasoning, outline challenges and future directions, and call on researchers to develop unified frameworks for robust, interpretable, and decision-relevant reasoning in real-world applications. The material is available at https://github.com/Eleanorkong/Awesome-Time-Series-Reasoning.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Decision Making | Decision Making OOD | ACC26.4 | 13 | |
| Causality Discovery | Causality Discovery OOD | Success Rate52.2 | 13 | |
| Decision Making | Decision Making (ID) | Accuracy23.8 | 13 | |
| Event-aware Forecasting | Event-aware Forecasting (OOD) | SR6.5 | 13 | |
| Causality Discovery | Causality Discovery (ID) | Success Rate50.2 | 13 | |
| Event-aware Forecasting | Event-aware Forecasting (ID) | Success Rate (%)12.2 | 13 | |
| Scenario Understanding | Scenario Understanding (OOD) | Success Rate32.6 | 13 | |
| Scenario Understanding | Scenario Understanding (ID) | Accuracy32.2 | 12 |