HEDP: A Hybrid Energy-Distance Prompt-based Framework for Domain Incremental Learning
About
Domain Incremental Learning is a critical scenario that requires models to continuously adapt to new data domains without retraining. However, domain shifts often cause severe performance degradation. To address this, we propose Hybrid Energy-Distance Prompt, a domain-incremental framework inspired by Helmholtz free energy. HEDP introduces an energy regularization loss to enhance the separability of domain representations and a hybrid energy-distance weighted mechanism that fuses energy-based and distance-based cues to improve domain selection and generalization. Experiments on multiple benchmarks, including CORe50, show that HEDP achieves superior performance on unseen domains with a 2.57\% accuracy gain, effectively mitigating catastrophic forgetting and enhancing open-world adaptability. Our code is \href{https://github.com/dannis97500/HEDP/}{available here}.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Domain-incremental learning | DomainNet | Average Accuracy67.09 | 17 | |
| Domain-incremental learning | CDDB-Hard (Known domains) | Average Accuracy93.72 | 16 | |
| Domain-incremental learning | CORe50 Unknown scenarios | Average Accuracy (AA)94.37 | 15 | |
| Domain-incremental learning | DomainNet Known | AA (all)74.19 | 14 | |
| Domain-incremental learning | CDDB-Hard Unknown domains | Average Accuracy83.74 | 8 |