Two-Way Is Better Than One: Bidirectional Alignment with Cycle Consistency for Exemplar-Free Class-Incremental Learning
About
Continual learning (CL) seeks models that acquire new skills without erasing prior knowledge. In exemplar-free class-incremental learning (EFCIL), this challenge is amplified because past data cannot be stored, making representation drift for old classes particularly harmful. Prototype-based EFCIL is attractive for its efficiency, yet prototypes drift as the embedding space evolves; therefore, projection-based drift compensation has become a popular remedy. We show, however, that existing one-directional projections introduce systematic bias: they either retroactively distort the current feature geometry or align past classes only locally, leaving cycle inconsistencies that accumulate across tasks. We introduce BiCyc, a bidirectional projector alignment approach with a cycle-consistency objective. BiCyc jointly optimizes two maps, old-to-new and new-to-old, with stop-gradient gating so that transport and representation co-evolve. Analytically, we show that the cycle loss contracts the singular spectrum toward unity in whitened space, and that improved transport of class means and covariances yields smaller perturbations of classification log-odds, preserving old-class decisions and mitigating catastrophic forgetting. Empirically, across standard EFCIL benchmarks, BiCyc substantially reduces forgetting and improves accuracy in from-scratch settings, while remaining competitive in the pretrained fine-grained regime.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Exemplar-Free Class-Incremental Learning | CIFAR-100 | -- | 112 | |
| Class-incremental learning | ImageNet-100 | Last Acc52.7 | 108 | |
| Exemplar-Free Class-Incremental Learning | TinyImageNet | Top-1 Acc (Inc)49.1 | 98 | |
| Class-incremental image classification | TinyImageNet | -- | 47 | |
| Class-incremental learning | CUB-200 | Last Accuracy (Alast)53.7 | 42 | |
| Class-incremental image classification | CUB-200 | Forgetting11.3 | 26 | |
| Class-incremental image classification | CIFAR-100 | -- | 22 | |
| Class-incremental image classification | ImageNet-100 | Last-task Forgetting (Flast)18.2 | 14 |