Debiasing Pretrained Generative Models by Uniformly Sampling Semantic Attributes
Walter Gerych, Kevin Hickey, Luke Buquicchio, Kavin Chandrasekaran, Abdulaziz Alajaji, Elke A. Rundensteiner, Emmanuel Agu
Abstract
Generative models are being increasingly used in science and industry applications. Unfortunately, they often perpetuate the biases present in their training sets, such as societal biases causing certain groups to be underrepresented in the data. For instance, image generators may overwhelmingly produce images of white people due to few non-white samples in their training data. It is imperative to debias generative models so they synthesize an equal number of instances for each group, while not requiring retraining of the model to avoid prohibitive expense. We thus propose a distribution mapping module that produces samples from a fair noise distribution , such that the pretrained generative model produces semantically uniform outputs - an equal number of instances for each group - when conditioned on these samples. This does not involve retraining the generator, nor does it require any real training data. Experiments on debiasing generators trained on popular real-world datasets show that our method outperforms state-of-the-art approaches.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7bf21567-63f7-4f7b-b317-df34266ee32aCited by top-tier papers1
Ask how each one uses itBuilds on13
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- Alias-Free Generative Adversarial NetworksTero Karras, Miika Aittala, Samuli Laine, Erik Härkönen et al.NeurIPS 2021 · 2,126 citations
Related papers
- Balancing Act: Distribution-Guided Debiasing in Diffusion ModelsRishubh Parihar, Abhijnya Bhat, Abhipsa Basu, Saswat Mallick et al.CVPR 2024 · 15 citations
- FairRAG: Fair Human Generation via Fair Retrieval AugmentationRobik Shrestha, Yang Zou, Qiuyu Chen, Zhiheng Li et al.CVPR 2024 · 6 citations
- Fair Text-to-Image Diffusion via Fair MappingJia Li, Lijie Hu, Jingfeng Zhang, Tianhang Zheng et al.AAAI 2025 · 36 citations
- FairGen: Enhancing Fairness in Text-to-Image Diffusion Models via Self-Discovering Latent DirectionsYilei Jiang, Wei-Hong Li, Yiyuan Zhang, Minghong Cai et al.ICCV 2025 · 9 citations
- InvDiff: Invariant Guidance for Bias Mitigation in Diffusion ModelsMin Hou, Yueying Wu, Chang Xu, Yu-Hao Huang et al.KDD 2025 · 2 citations
