Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Learning to Generate Multiple Objects from Dense and Occluded Layouts

About

Text-to-image diffusion models fail to generate correct object counts in dense scenes, where overlapping instances collapse into indistinguishable structures despite appearing visually plausible. We identify this as instance ownership collapse: tokens from overlapping objects interact freely through attention, while heavily occluded instances receive weak supervision due to their small visible areas. We address this through layout-aware attention biases that softly bias token interactions toward region-consistent grouping and suppress cross-instance leakage, paired with an amodal-balanced loss that amplifies gradients for occluded objects based on their occlusion level. To enable systematic evaluation, we introduce OverlapDepth-45K, a benchmark of densely overlapping scenes with amodal supervision. Our approach substantially improves count accuracy and prevents instance merging while preserving image quality. Project page: https://bachngoh.github.io/AIBL

Bach-Hoang Ngo, Si-Tri Ngo, Hieu Le, Trung-Nghia Le• 2026

Related benchmarks

TaskDatasetResultRank
CountingCoCoCount (test)
YOLOv9 Accuracy58
8
CountingT2I-Compbench counting (test)
Human Accuracy65
8
CountingOverlapDepth-45K 1,000-image (test)
Exact Accuracy15.32
6
Showing 3 of 3 rows

Other info

Follow for update