Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

STELLA: Guiding Large Language Models for Time Series Forecasting with Semantic Abstractions

About

Recent adaptations of Large Language Models (LLMs) for time series forecasting often fail to effectively enhance information for raw series, leaving LLM reasoning capabilities underutilized. Existing prompting strategies rely on static correlations rather than generative interpretations of dynamic behavior, lacking critical global and instance-specific context. To address this, we propose STELLA (Semantic-Temporal Alignment with Language Abstractions), a framework that systematically mines and injects structured supplementary and complementary information. STELLA employs a dynamic semantic abstraction mechanism that decouples input series into trend, seasonality, and residual components. It then translates intrinsic behavioral features of these components into Hierarchical Semantic Anchors: a Corpus-level Semantic Prior (CSP) for global context and a Fine-grained Behavioral Prompt (FBP) for instance-level patterns. Using these anchors as prefix-prompts, STELLA guides the LLM to model intrinsic dynamics. Experiments on eight benchmark datasets demonstrate that STELLA outperforms state-of-the-art methods in long- and short-term forecasting, showing superior generalization in zero-shot and few-shot settings. Ablation studies further validate the effectiveness of our dynamically generated semantic anchors.

Junjie Fan, Hongye Zhao, Linduo Wei, Jiayu Rao, Guijia Li, Jiaxin Yuan, Wenqi Xu, Yong Qi• 2025

Related benchmarks

TaskDatasetResultRank
Time Series ForecastingETTh1 (test)
MSE0.617
262
Time Series ForecastingETTm1 (test)
MSE0.543
196
Time Series ForecastingETTh2 (test)
MSE0.414
140
Time Series ForecastingETTm2 (test)
MSE0.291
89
Short-term forecastingM4 Quarterly
MASE1.164
67
Short-term forecastingM4 Yearly
MASE2.978
63
Short-term forecastingM4 Monthly
SMAPE12.608
61
Short-term forecastingM4 (Others)
SMAPE4.651
51
Time Series ForecastingETTh1 -> ETTm2 (test)
MSE0.312
45
Multivariate long-term forecastingETTm1 v1 (test)
MSE0.379
28
Showing 10 of 20 rows

Other info

Follow for update