Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Fed-CPrompt: Contrastive Prompt for Rehearsal-Free Federated Continual Learning

About

Federated continual learning (FCL) learns incremental tasks over time from confidential datasets distributed across clients. This paper focuses on rehearsal-free FCL, which has severe forgetting issues when learning new tasks due to the lack of access to historical task data. To address this issue, we propose Fed-CPrompt based on prompt learning techniques to obtain task-specific prompts in a communication-efficient way. Fed-CPrompt introduces two key components, asynchronous prompt learning, and contrastive continual loss, to handle asynchronous task arrival and heterogeneous data distributions in FCL, respectively. Extensive experiments demonstrate the effectiveness of Fed-CPrompt in achieving SOTA rehearsal-free FCL performance.

Gaurav Bagwe, Xiaoyong Yuan, Miao Pan, Lan Zhang• 2023

Related benchmarks

TaskDatasetResultRank
Federated Continual LearningDomainNet
Average Performance71.28
13
Federated Continual LearningImageNet-R
Avg Accuracy76.75
13
Federated Continual LearningCIFAR-100
Average Accuracy94.22
13
Showing 3 of 3 rows

Other info

Follow for update