QASA: Quality-Guided K-Adaptive Slot Attention for Unsupervised Object-Centric Learning
About
Slot Attention, an approach that binds different objects in a scene to a set of "slots", has become a leading method in unsupervised object-centric learning. Most methods assume a fixed slot count K, and to better accommodate the dynamic nature of object cardinality, a few works have explored K-adaptive variants. However, existing K-adaptive methods still suffer from two limitations. First, they do not explicitly constrain slot-binding quality, so low-quality slots lead to ambiguous feature attribution. Second, adding a slot-count penalty to the reconstruction objective creates conflicting optimization goals between reducing the number of active slots and maintaining reconstruction fidelity. As a result, they still lag significantly behind strong K-fixed baselines. To address these challenges, we propose Quality-Guided K-Adaptive Slot Attention (QASA). First, we decouple slot selection from reconstruction, eliminating the mutual constraints between the two objectives. Then, we propose an unsupervised Slot-Quality metric to assess per-slot quality, providing a principled signal for fine-grained slot--object binding. Based on this metric, we design a Quality-Guided Slot Selection scheme that dynamically selects a subset of high-quality slots and feeds them into our newly designed gated decoder for reconstruction during training. At inference, token-wise competition on slot attention yields a K-adaptive outcome. Experiments show that QASA substantially outperforms existing K-adaptive methods on both real and synthetic datasets. Moreover, on real-world datasets QASA surpasses K-fixed methods.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Unsupervised Object Segmentation | COCO | mBOi36.7 | 26 | |
| Object-Centric Learning | Pascal | MBO^i49.7 | 18 | |
| Object-Centric Learning | MOVi-C | MBO^i46.9 | 17 | |
| Object-Centric Learning | MOVi-E | MBO^i39.1 | 13 | |
| Object Discovery | COCO | -- | 13 | |
| Object Discovery | MOVi-C | mBOi46.9 | 6 | |
| Object Discovery | MOVi-E | mBOi39.1 | 4 | |
| Object Discovery | Pascal VOC | mBOi49.7 | 3 |