SAFO: Stable Adaptive Fairness Optimization for LLM-Based Social Survey Simulation
Chenxi Lin, Zhuoren Jiang, Kaisong Song, Yiquan Wu
Abstract
Ensuring fairness in social survey simulation is critical, as biased outputs can misrepresent underrepresented groups. This issue is growing as large language models (LLMs) are increasingly used for this task. However, standard finetuning based on Empirical Risk Minimization (ERM) often under-optimizes minority groups, causing substantial subgroup disparities. Distributionally robust Optimization (DRO) methods reduce worst-case errors, but their strict worst-case selection can lead to noisy and unstable optimization under demographic sparsity. These issues create intertwined challenges for fairness, convergence and stability. We propose SAFO, a dynamic utility-fairness optimization framework for LLM-based survey simulation that explicitly targets both fairness and training stability. SAFO combines (i) an Optimizer that preserves mean-loss utility, (ii) an Adversary that performs temperature-controlled, EMAsmoothed and loss-driven group reweighting, and (iii) a Nash-inspired Regulator that adaptively adjusts the utility-fairness trade-off by tracking weak-group gains and collateral utility damages. Experiments on three large-scale survey datasets from China, the U.S., and Europe show that SAFO consistently improves minority performance and social-welfare metrics. It reduces worst-group gaps by up to 12.7%, maintains overall accuracy with a mean change of less than 0.3% and lowers variance across random seeds. Our code is available at https://github.com/PiLab-ZJU/SAFO .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext dea5210b-b849-4bcd-a03f-8d62edd9e990Builds on6
- Fair Influence Maximization: a Welfare Optimization ApproachAida Rahmattalabi, Shahin Jabbari, Himabindu Lakkaraju, Phebe Vayanos et al.AAAI 2021 · 71 citations
- Language Model Fine-Tuning on Scaled Survey Data for Predicting Distributions of Public OpinionsJoseph Suh, Erfan Jahanparast, Suhong Moon, Minwoo Kang et al.ACL 2025 · 48 citations
- Fairness through Difference Awareness: Measuring Desired Group Discrimination in LLMsAngelina Wang, Michelle Phan, Daniel E. Ho, Sanmi KoyejoACL 2025 · 17 citations
- Distributionally Robust Optimization with Probabilistic GroupSoumya Suvra Ghosal, Yixuan LiAAAI 2023 · 14 citations
- On the Fairness ROAD: Robust Optimization for Adversarial DebiasingVincent Grari, Thibault Laugel, Tatsunori Hashimoto, Sylvain Lamprier et al.ICLR 2024 · 6 citations
Related papers
- Re-weighting Based Group Fairness Regularization via Classwise Robust OptimizationSangwon Jung, Taeeon Park, Sanghyuk Chun, Taesup MoonICLR 2023 · 5 citations
- Does LLM Focus on the Right Words? Mitigating Context Bias in LLM-based RecommendersBohao Wang, Jiawei Chen, Feng Liu, Changwang Zhang et al.WWW 2026 · 1 citation
- MaxMin-RLHF: Alignment with Diverse Human PreferencesSouradip Chakraborty, Jiahao Qiu, Hui Yuan, Alec Koppel et al.ICML 2024 · 104 citations
- Task-level Distributionally Robust Optimization for Large Language Model-based Dense RetrievalGuangyuan Ma, Yongliang Ma, Xing Wu, Zhenpeng Su et al.AAAI 2025 · 6 citations
- Distributionally Robust Reinforcement Learning from Human FeedbackDebmalya Mandal, Paulius Sasnauskas, Goran RadanovicICML 2026
