Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Class-wise Balancing Data Replay for Federated Class-Incremental Learning

About

Federated Class Incremental Learning (FCIL) aims to collaboratively process continuously increasing incoming tasks across multiple clients. Among various approaches, data replay has become a promising solution, which can alleviate forgetting by reintroducing representative samples from previous tasks. However, their performance is typically limited by class imbalance, both within the replay buffer due to limited global awareness and between replayed and newly arrived classes. To address this issue, we propose a class wise balancing data replay method for FCIL (FedCBDR), which employs a global coordination mechanism for class-level memory construction and reweights the learning objective to alleviate the aforementioned imbalances. Specifically, FedCBDR has two key components: 1) the global-perspective data replay module reconstructs global representations of prior task in a privacy-preserving manner, which then guides a class-aware and importance-sensitive sampling strategy to achieve balanced replay; 2) Subsequently, to handle class imbalance across tasks, the task aware temperature scaling module adaptively adjusts the temperature of logits at both class and instance levels based on task dynamics, which reduces the model's overconfidence in majority classes while enhancing its sensitivity to minority classes. Experimental results verified that FedCBDR achieves balanced class-wise sampling under heterogeneous data distributions and improves generalization under task imbalance between earlier and recent tasks, yielding a 2%-15% Top-1 accuracy improvement over six state-of-the-art methods.

Zhuang Qi, Ying-Peng Tang, Lei Meng, Han Yu, Xiaoxiao Li, Xiangxu Meng• 2025

Related benchmarks

TaskDatasetResultRank
Visual Localizationi7Scenes
Translation Error (cm)2.3
49
Federated Continual LearningCIFAR10 3 Tasks
Accuracy65.88
36
Visual LocalizationSimulation Dataset
Median Translation Error (cm)0.4
18
Visual Localizationi12Scenes 5° 5 cm threshold (test)--
12
Streaming Federated Continual LearningCIFAR100 O=5 overlap
Average Accuracy21.91
8
Streaming Federated Continual LearningCIFAR100 O=4 overlap
Average Accuracy0.2073
8
Streaming Federated Continual LearningCIFAR100 O=2 overlap
Average Accuracy (AA)18.44
8
Streaming Federated Continual LearningCIFAR100 O=0 overlap
Average Accuracy (AA)19.09
8
Streaming Federated Continual LearningImageNet 100 O=5 overlap
Average Accuracy19.01
8
Streaming Federated Continual LearningImageNet100 O=4 overlap
Average Accuracy (AA)18.9
8
Showing 10 of 14 rows

Other info

Follow for update