Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Rethinking Few-Shot Class-Incremental Learning with Open-Set Hypothesis in Hyperbolic Geometry

About

Few-Shot Class-Incremental Learning (FSCIL) aims at incrementally learning novel classes from a few labeled samples by avoiding the overfitting and catastrophic forgetting simultaneously. The current protocol of FSCIL is built by mimicking the general class-incremental learning setting, while it is not totally appropriate due to the different data configuration, i.e., novel classes are all in the limited data regime. In this paper, we rethink the configuration of FSCIL with the open-set hypothesis by reserving the possibility in the first session for incoming categories. To assign better performances on both close-set and open-set recognition to the model, Hyperbolic Reciprocal Point Learning module (Hyper-RPL) is built on Reciprocal Point Learning (RPL) with hyperbolic neural networks. Besides, for learning novel categories from limited labeled data, we incorporate a hyperbolic metric learning (Hyper-Metric) module into the distillation-based framework to alleviate the overfitting issue and better handle the trade-off issue between the preservation of old knowledge and the acquisition of new knowledge. The comprehensive assessments of the proposed configuration and modules on three benchmark datasets are executed to validate the effectiveness concerning three evaluation indicators.

Yawen Cui, Zitong Yu, Wei Peng, Li Liu• 2022

Related benchmarks

TaskDatasetResultRank
Few-Shot Class-Incremental LearningminiImageNet (test)
Accuracy (Session 1)59
173
Few-Shot Class-Incremental LearningCIFAR100 (test)
Session 4 Top-1 Acc55.68
122
Few-Shot Class-Incremental LearningCUB200 (test)
Accuracy (Session 1)62.61
92
Few-Shot Class-Incremental LearningCUB-200
Session 1 Accuracy62.61
75
Few-Shot Class-Incremental LearningMiniImagenet
Avg Accuracy53.04
31
Showing 5 of 5 rows

Other info

Follow for update