GASS: Geometry-Aware Spherical Sampling for Disentangled Diversity Enhancement in Text-to-Image Generation
Ye Zhu, Kaleb Newman, Johannes Lutzeyer, Adriana Romero-Soriano, Michal Drozdzal, Olga Russakovsky
Abstract
Despite high semantic alignment, modern textto-image (T2I) generative models still struggle to synthesize diverse images from a given prompt. In this work, we enhance the T2I diversity through a geometric lens. Unlike most existing methods that rely primarily on entropy-based guidance to increase sample dissimilarity, we introduce Geometry-Aware Spherical Sampling (GASS) to enhance diversity by explicitly controlling both prompt-dependent and prompt-independent sources of variation. Specifically, we decompose the diversity measure in CLIP embeddings using two orthogonal directions: the text embedding, which captures semantic variation related to the prompt, and an identified orthogonal direction that captures prompt-independent variation (e.g., backgrounds). Based on this decomposition, GASS increases the geometric projection spread of generated image embeddings along both axes and guides the T2I sampling process via expanded predictions along the generation trajectory. Our experiments on different frozen T2I backbones (U-Net and DiT, diffusion and flow) and benchmarks demonstrate the effectiveness of disentangled diversity enhancement with minimal impact on image fidelity and semantic alignment 1 .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on26
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li et al.NeurIPS 2022 · 8,965 citations
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
Related papers
- Scendi Score: Prompt-Aware Diversity Evaluation Via Schur Complement of Clip EmbeddingsAzim Ospanov, Mohammad Jalali, Farzan FarniaICCV 2025 · 17 citations
- Letting Trajectories Spread: Quality-Preserving Control for Diverse Flow MatchingJingxuan Wu, Zhenglin Wan, Xingrui Yu, Yuzhe YANG et al.ICML 2026 · 1 citation
- SPARKE: Scalable Prompt-Aware Diversity and Novelty Guidance in Diffusion Models via RKE ScoreMohammad Jalali, Haoyu Lei, Amin Gohari, Farzan FarniaNeurIPS 2025 · 15 citations
- DOS: Directional Object Separation in Text Embeddings for Multi-Object Image GenerationDongnam Byun, Jungwon Park, Jungmin Ko, Changin Choi et al.AAAI 2026
- Breaking the Lock-in: Diversifying Text-to-Image Generation via Representation ModulationDahee Kwon, Haeun Lee, Jaesik ChoiICML 2026
