Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Scaling Group Inference for Diverse and High-Quality Generation

About

Generative models typically sample outputs independently, and recent inference-time guidance and scaling algorithms focus on improving the quality of individual samples. However, in real-world applications, users are often presented with a set of multiple images (e.g., 4-8) for each prompt, where independent sampling tends to lead to redundant results, limiting user choices and hindering idea exploration. In this work, we introduce a scalable group inference method that improves both the diversity and quality of a group of samples. We formulate group inference as a quadratic integer assignment problem: candidate outputs are modeled as graph nodes, and a subset is selected to optimize sample quality (unary term) while maximizing group diversity (binary term). To substantially improve runtime efficiency, we progressively prune the candidate set using intermediate predictions, allowing our method to scale up to large candidate sets. Extensive experiments show that our method significantly improves group diversity and quality compared to independent sampling baselines and recent inference algorithms. Our framework generalizes across a wide range of tasks, including text-to-image, image-to-image, image prompting, and video generation, enabling generative models to treat multiple outputs as cohesive groups rather than independent samples.

Gaurav Parmar, Or Patashnik, Daniil Ostashev, Kuan-Chieh Wang, Kfir Aberman, Srinivasa Narasimhan, Jun-Yan Zhu• 2025

Related benchmarks

TaskDatasetResultRank
Text-to-Image GenerationCOCO 2014 (val)--
34
Text-to-Image GenerationCOCO prompts
Vendi1.916
18
Text-to-Image GenerationGenEval
DINO0.749
18
Text-to-Image GenerationT2I-CompBench 1.0 (test)
CLIP Score0.335
14
Text-to-Image GenerationUser Study Human Evaluation--
12
Text-to-Image GenerationT2I-CompBench
DINO Score0.701
9
Text-to-Image GenerationGenEval
DreamSim Score0.413
6
Showing 7 of 7 rows

Other info

Follow for update