Dissecting Generalized Category Discovery: Multiplex Consensus under Self-Deconstruction
About
Human perceptual systems excel at inducing and recognizing objects across both known and novel categories, a capability far beyond current machine learning frameworks. While generalized category discovery (GCD) aims to bridge this gap, existing methods predominantly focus on optimizing objective functions. We present an orthogonal solution, inspired by the human cognitive process for novel object understanding: decomposing objects into visual primitives and establishing cross-knowledge comparisons. We propose ConGCD, which establishes primitive-oriented representations through high-level semantic reconstruction, binding intra-class shared attributes via deconstruction. Mirroring human preference diversity in visual processing, where distinct individuals leverage dominant or contextual cues, we implement dominant and contextual consensus units to capture class-discriminative patterns and inherent distributional invariants, respectively. A consensus scheduler dynamically optimizes activation pathways, with final predictions emerging through multiplex consensus integration. Extensive evaluations across coarse- and fine-grained benchmarks demonstrate ConGCD's effectiveness as a consensus-aware paradigm. Code is available at github.com/lytang63/ConGCD.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Generalized Category Discovery | CIFAR-100 | Accuracy (All)82.5 | 268 | |
| Generalized Category Discovery | ImageNet-100 | All Accuracy85.9 | 252 | |
| Generalized Category Discovery | Stanford Cars | Accuracy (All)79.8 | 228 | |
| Generalized Category Discovery | CUB | Accuracy (All)86.3 | 186 | |
| Generalized Category Discovery | CIFAR-10 | Clustering Accuracy (All)97.4 | 42 | |
| Generalized Category Discovery | SSB Average | Accuracy (All)82.6 | 33 | |
| Category Discovery | Stanford Cars Old classes | Accuracy79 | 31 | |
| Generalized Category Discovery | FGVC-Aircraft New classes | Clustering Accuracy59.2 | 16 | |
| Generalized Category Discovery | CUB-200 New classes | Clustering Accuracy67.8 | 16 | |
| Generalized Category Discovery | FGVC-Aircraft All classes | Clustering Accuracy59.7 | 16 |