Scaling Group Inference for Diverse and High-Quality Generation
Gaurav Parmar, Or Patashnik, Daniil Ostashev, Kuan-Chieh Wang, Kfir Aberman, Srinivasa G. Narasimhan, Jun-Yan Zhu
Abstract
Generative models typically sample outputs independently, and recent inference-time guidance and scaling algorithms focus on improving the quality of individual samples. However, in real-world applications, users are often presented with a set of multiple images (e.g., 4-8) for each prompt, where independent sampling tends to lead to redundant results, limiting user choices and hindering idea exploration. In this work, we introduce a scalable group inference method that improves both the diversity and quality of a group of samples. We formulate group inference as a quadratic integer assignment problem: candidate outputs are modeled as graph nodes, and a subset is selected to optimize sample quality (unary term) while maximizing group diversity (binary term). To substantially improve runtime efficiency, we use intermediate predictions of the final sample at each step to progressively prune the candidate set, allowing our method to scale up efficiently to large input candidate sets. Extensive experiments show that our method significantly improves group diversity and quality compared to independent sampling baselines and recent inference algorithms. Our framework generalizes across a wide range of tasks, including text-to-image, image-to-image, and image prompting, enabling generative models to treat multiple outputs as cohesive groups rather than independent samples.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers4
- It's Never Too Late: Noise Optimization for Collapse Recovery in Trained Diffusion ModelsAnne Harrington, A. Sophia Koepke, Shyamgopal Karthik, Trevor Darrell et al.CVPR 2026 · 12 citations
- Diverse Video Generation with Determinantal Point Process-Guided Policy OptimizationTahira Kazimi, Connor Dunlop, Pinar YanardagCVPR 2026 · 4 citations
- On-the-fly Repulsion in the Contextual Space for Rich Diversity in Diffusion TransformersOmer Dahary, Benaya Koren, Daniel Garibi, Daniel Cohen-OrSIGGRAPH 2026 · 1 citation
- Composing People Together: Iterative Pose-Image Generation for Multi-Person Interaction ScenesWenxuan Peng, Bharath Hariharan, Hadar Averbuch-ElorSIGGRAPH 2026
Builds on27
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
Related papers
- GuidedSampling: Steering LLMs Towards Diverse Candidate Solutions at Inference-TimeDivij Handa, Mihir Parmar, Aswin RRV, Md Nayem Uddin et al.ICLR 2026 · 6 citations
- Group Diffusion: Enhancing Image Generation by Unlocking Cross-Sample CollaborationSicheng Mo, Thao Nguyen, Richard Zhang, Nick Kolkin et al.CVPR 2026 · 1 citation
- G2: Guided Generation for Enhanced Output Diversity in LLMsZhiwen Ruan, Yixia Li, Yefeng Liu, Yun Chen et al.EMNLP 2025
- Particle Guidance: non-I.I.D. Diverse Sampling with Diffusion ModelsGabriele Corso, Yilun Xu, Valentin De Bortoli, Regina Barzilay et al.ICLR 2024 · 52 citations
- The Intricate Dance of Prompt Complexity, Quality, Diversity and Consistency in T2I ModelsXiaofeng Zhang, Aaron C. Courville, Michal Drozdzal, Adriana Romero-SorianoICLR 2026 · 6 citations
