Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

LLM4CP: Adapting Large Language Models for Channel Prediction

About

Channel prediction is an effective approach for reducing the feedback or estimation overhead in massive multi-input multi-output (m-MIMO) systems. However, existing channel prediction methods lack precision due to model mismatch errors or network generalization issues. Large language models (LLMs) have demonstrated powerful modeling and generalization abilities, and have been successfully applied to cross-modal tasks, including the time series analysis. Leveraging the expressive power of LLMs, we propose a pre-trained LLM-empowered channel prediction method (LLM4CP) to predict the future downlink channel state information (CSI) sequence based on the historical uplink CSI sequence. We fine-tune the network while freezing most of the parameters of the pre-trained LLM for better cross-modality knowledge transfer. To bridge the gap between the channel data and the feature space of the LLM, preprocessor, embedding, and output modules are specifically tailored by taking into account unique channel characteristics. Simulations validate that the proposed method achieves SOTA prediction performance on full-sample, few-shot, and generalization tests with low training and inference costs.

Boxun Liu, Xuanyu Liu, Shijian Gao, Xiang Cheng, Liuqing Yang• 2024

Related benchmarks

TaskDatasetResultRank
Time-Domain PredictionD2
NMSE (dB)-18.58
6
Time-Domain PredictionD3
NMSE (dB)-14.54
6
Time-Domain PredictionD4
NMSE (dB)-6.28
6
Time-Domain PredictionD5
NMSE (dB)-13.3
6
Time-Domain PredictionD7
NMSE (dB)-11.91
6
Time-Domain PredictionD8
NMSE (dB)-4.91
6
Time-Domain PredictionD10
NMSE (dB)-9.05
6
Time-Domain PredictionD12
NMSE (dB)-6.14
6
Time-Domain PredictionD1
NMSE (dB)-19.34
6
Time-Domain PredictionD6
NMSE (dB)-2.52
6
Showing 10 of 24 rows

Other info

Follow for update