Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

TSQAgent: Rating Time Series Data Quality via Dedicated Agentic Reasoning

About

Assessing the quality of time series (TS) data is fundamental yet inherently challenging due to the multifaceted nature of quality dimensions. Recently, large language models (LLMs) have emerged as a promising paradigm for TS quality assessment via pairwise comparison and per-dimension evaluation. However, existing approaches rely on manually predefined quality dimensions and purely text-based reasoning, leaving it unknown whether LLMs can identify truly relevant quality dimensions or perform grounded and quantitative quality comparisons. To investigate this, we construct TSQBench, a dedicated benchmark for evaluating LLMs on two progressive capabilities: (i) understanding and identifying relevant quality dimensions, and (ii) performing quality comparison under specific dimensions. Our analysis reveals that current LLMs consistently struggle with both dimension identification and evidence-grounded quality comparison. To address these limitations, we propose TSQAgent, a novel agentic reasoning framework for TS quality rating consisting of three collaborative roles: Perceiver for focused dimension selection, Inspector for dimension-wise quantitative analysis, and Adjudicator that aggregates and refines the final judgment. In particular, we introduce an agentic reasoning strategy that instills the ability to identify and prioritize the most relevant quality dimensions, and further propose an agent workflow equipped with external analytical tools to enable precise quantitative comparisons over selected dimensions. Experiments on both the proposed benchmark and eleven real-world datasets demonstrate that our framework not only substantially improves LLMs' capabilities in quality understanding and quantitative comparison but also effectively translates these improvements into better quality-aware data selection, leading to enhanced downstream performance and data efficiency.

Shunyu Wu, Dan Li, Haozheng Ye, Weibin Feng, Jian Lou, Bo Zhang, Wenjie Feng, Chenjuan Guo, See-Kiong Ng• 2026

Related benchmarks

TaskDatasetResultRank
Time Series ForecastingWeather (test)--
355
Time Series ForecastingTraffic (test)--
334
Time Series ForecastingElectricity (test)--
237
Short-term forecastingM4 Yearly--
168
Short-term forecastingM4 Monthly--
150
Time-series classificationHandwriting
Accuracy16.6
80
Time Series ForecastingM4 Daily
MAPE1.096
48
Long-term forecastingWeather
RMSE0.45
48
Long-term forecastingExchange Rate (ExRate)
RMSE0.214
48
Time-series classificationCBF
Accuracy66.8
30
Showing 10 of 15 rows

Other info

Follow for update