Learning to Generate Multiple Objects from Dense and Occluded Layouts
About
Text-to-image diffusion models fail to generate correct object counts in dense scenes, where overlapping instances collapse into indistinguishable structures despite appearing visually plausible. We identify this as instance ownership collapse: tokens from overlapping objects interact freely through attention, while heavily occluded instances receive weak supervision due to their small visible areas. We address this through layout-aware attention biases that softly bias token interactions toward region-consistent grouping and suppress cross-instance leakage, paired with an amodal-balanced loss that amplifies gradients for occluded objects based on their occlusion level. To enable systematic evaluation, we introduce OverlapDepth-45K, a benchmark of densely overlapping scenes with amodal supervision. Our approach substantially improves count accuracy and prevents instance merging while preserving image quality. Project page: https://bachngoh.github.io/AIBL
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Counting | CoCoCount (test) | YOLOv9 Accuracy58 | 8 | |
| Counting | T2I-Compbench counting (test) | Human Accuracy65 | 8 | |
| Counting | OverlapDepth-45K 1,000-image (test) | Exact Accuracy15.32 | 6 |