Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

FedLLM: A Privacy-Preserving Federated Large Language Model for Explainable Traffic Flow Prediction

About

Traffic prediction plays a central role in intelligent transportation systems (ITS) by supporting real-time decision-making, congestion management, and long-term planning. However, many existing approaches face practical limitations. Most spatio-temporal models are trained on centralized data, rely on numerical representations, and offer limited explainability. Recent Large Language Model (LLM) methods improve reasoning capabilities but typically assume centralized data availability and do not fully capture the distributed and heterogeneous nature of real-world traffic systems. To address these challenges, this study proposes FedLLM (Federated LLM), a privacy-preserving and distributed framework for explainable multi-horizon short-term traffic flow prediction (15-60 minutes). The framework introduces four key contributions: 1) a Composite Selection Score (CSS) for data-driven freeway selection that captures structural diversity across traffic regions 2) a domain-adapted LLM fine-tuned on structured traffic prompts encoding spatial, temporal, and statistical context 3) FedLLM framework, that enables collaborative training across heterogeneous clients while exchanging only lightweight LoRA adapter parameters, 4) a structured prompt representation that supports contextual reasoning and cross-region generalization. The FedLLM design allows each client to learn from local traffic patterns while contributing to a shared global model through efficient parameter exchange, reducing communication overhead and keeping data private. This setup supports learning under non-IID traffic distributions. Experimental results show that FedLLM achieves improved predictive performance over centralized baselines, while producing structured and explainable outputs. These findings highlight the potential of combining FL with domain-adapted LLMs for scalable, privacy-aware, and explainable traffic prediction.

Seerat Kaur, Sukhjit Singh Sehra, Dariush Ebrahimi• 2026

Related benchmarks

TaskDatasetResultRank
Traffic ForecastingGBA
MAE (Average)15.07
21
Traffic ForecastingGBA Traffic Dataset 15 min horizon
RMSE16.3
10
Traffic ForecastingGBA Traffic Dataset 30 min horizon
RMSE21.33
10
Traffic ForecastingGBA Traffic Dataset 45 min horizon
RMSE25.42
10
Traffic ForecastingGBA Traffic Dataset 60 min horizon
RMSE30.18
10
Traffic Flow PredictionLargeST 15 min horizon
RMSE24.76
8
Traffic Flow PredictionLargeST 30 min horizon
RMSE32.16
8
Traffic Flow PredictionLargeST 45 min horizon
RMSE (45 min)37.89
8
Traffic Flow PredictionLargeST 60 min horizon
RMSE44.76
8
Traffic Flow PredictionLargeST (Overall)
RMSE35.66
8
Showing 10 of 10 rows

Other info

Follow for update