Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Two-Way Is Better Than One: Bidirectional Alignment with Cycle Consistency for Exemplar-Free Class-Incremental Learning

About

Continual learning (CL) seeks models that acquire new skills without erasing prior knowledge. In exemplar-free class-incremental learning (EFCIL), this challenge is amplified because past data cannot be stored, making representation drift for old classes particularly harmful. Prototype-based EFCIL is attractive for its efficiency, yet prototypes drift as the embedding space evolves; therefore, projection-based drift compensation has become a popular remedy. We show, however, that existing one-directional projections introduce systematic bias: they either retroactively distort the current feature geometry or align past classes only locally, leaving cycle inconsistencies that accumulate across tasks. We introduce BiCyc, a bidirectional projector alignment approach with a cycle-consistency objective. BiCyc jointly optimizes two maps, old-to-new and new-to-old, with stop-gradient gating so that transport and representation co-evolve. Analytically, we show that the cycle loss contracts the singular spectrum toward unity in whitened space, and that improved transport of class means and covariances yields smaller perturbations of classification log-odds, preserving old-class decisions and mitigating catastrophic forgetting. Empirically, across standard EFCIL benchmarks, BiCyc substantially reduces forgetting and improves accuracy in from-scratch settings, while remaining competitive in the pretrained fine-grained regime.

Hongye Xu, Bartosz Krawczyk• 2026

Related benchmarks

TaskDatasetResultRank
Exemplar-Free Class-Incremental LearningCIFAR-100--
112
Class-incremental learningImageNet-100
Last Acc52.7
108
Exemplar-Free Class-Incremental LearningTinyImageNet
Top-1 Acc (Inc)49.1
98
Class-incremental image classificationTinyImageNet--
47
Class-incremental learningCUB-200
Last Accuracy (Alast)53.7
42
Class-incremental image classificationCUB-200
Forgetting11.3
26
Class-incremental image classificationCIFAR-100--
22
Class-incremental image classificationImageNet-100
Last-task Forgetting (Flast)18.2
14
Showing 8 of 8 rows

Other info

Follow for update