Do LLMs have Consistent Values?
Naama Rozen, Liat Bezalel, Gal Elidan, Amir Globerson, Ella Daniel
Abstract
Large Language Models (LLM) technology is rapidly advancing towards humanlike dialogue. Values are fundamental drivers of human behavior, yet research on the values expressed in LLM-generated text remains limited. While prior work has begun to explore value ranking in LLMs, the crucial aspect of value correlationthe interrelationship and consistency between different values -has been largely unexamined. Drawing on established psychological theories of human value structure, this paper investigates whether LLMs exhibit human-like value correlations within a single session, reflecting a coherent "persona". Our findings reveal that standard prompting methods fail to produce human-consistent value correlations. However, we demonstrate that a novel prompting strategy (referred to as "Value Anchoring"), significantly improves the alignment of LLM value correlations with human data. Furthermore, we analyze the mechanism by which Value Anchoring achieves this effect. These results not only deepen our understanding of value representation in LLMs but also introduce new methodologies for evaluating consistency and human-likeness in LLM responses, highlighting the importance of explicit value prompting for generating human-aligned outputs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a4fd5f89-5088-4e4f-93e8-2999f1e9b818Cited by top-tier papers7
- Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIsMantas Mazeika, Xuwang Yin, Rishub Tamirisa, Jaehyuk Lim et al.NeurIPS 2025 · 84 citations
- Consistently Simulating Human Personas with Multi-Turn Reinforcement LearningMarwa Abdulhai, Ryan Cheng, Donovan Clay, Tim Althoff et al.NeurIPS 2025 · 51 citations
- LitmusValues: Will AI Tell Lies to Save Sick Children? Litmus-Testing AI Values Prioritization with AIRiskDilemmasYu Ying Chiu, Zhilin Wang, Sharan Maiya, Yejin Choi et al.ICLR 2026 · 13 citations
- FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific InsightsZhen Wang, Fan Bai, Zhongyan Luo, Jinyan Su et al.ICML 2026 · 2 citations
- IROTE: Human-like Traits Elicitation of Large Language Model via In-Context Self-Reflective OptimizationYuzhuo Bai, Shitong Duan, Muhua Huang, Jing Yao et al.AAAI 2026 · 1 citation
Builds on9
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
- Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject StudiesGati V. Aher, Rosa I. Arriaga, Adam Tauman KalaiICML 2023 · 651 citations
- Evaluating the Moral Beliefs Encoded in LLMsNino Scherrer, Claudia Shi, Amir Feder, David M. BleiNeurIPS 2023 · 316 citations
- In-Context Impersonation Reveals Large Language Models' Strengths and BiasesLeonard Salewski, Stephan Alaniz, Isabel Rio-Torto, Eric Schulz et al.NeurIPS 2023 · 259 citations
- Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMsShashank Gupta, Vaishnavi Shrivastava, Ameet Deshpande, Ashwin Kalyan et al.ICLR 2024 · 212 citations
Related papers
- Inertia in Moral and Value Judgments of Large Language ModelsBruce W. Lee, Yeongheon Lee, Hyunsoo ChoACL 2026 · 5 citations
- Beyond Value Benchmarks: Measuring Value-Structure Alignment in Large Language Models via Symmetric Q-SortsJingting Zheng, Yuqi Ren, Linhao Yu, Yongqi Leng et al.ACL 2026
- Dual Mechanisms of Value Expression: Intrinsic vs. Prompted Values in Large Language ModelsJongwook Han, Jongwon Lim, Injin Kong, Yohan JoICML 2026
- Quantifying the Persona Effect in LLM SimulationsTiancheng Hu, Nigel CollierACL 2024 · 22 citations
- Revisiting LLM Value Probing Strategies: Are They Robust and Expressive?Siqi Shen, Mehar Singh, Lajanugen Logeswaran, Moontae Lee et al.EMNLP 2025
