ACL Findings2026
Machine Behavior in Relational Moral Dilemmas: Moral Rightness, Predicted Human Behavior, and Model Decisions
Jiseon Kim, Jea Kwon, Luiz Felipe Vecchietti, Wenchao Dong, Jaehong Kim, Meeyoung Cha
Abstract
Human moral judgment is context-dependent and modulated by interpersonal relationships. As large language models (LLMs) increasingly function as decision-support systems, determining whether they encode these social nuances is critical. We characterize machine behavior using the Whistleblower's Dilemma by varying two experimental dimensions: crime severity and relational closeness. Our study evaluates three distinct perspectives: (1) moral rightness (prescriptive norms), (2) predicted human behavior (descriptive social expectations), and (3) autonomous model decision-making. By analyzing the reasoning processes, we identify a clear cross-perspective divergence: while moral rightness remains consistently fairnessoriented, predicted human behavior shifts significantly toward loyalty as relational closeness increases. Crucially, model decisions align with moral rightness judgments rather than their own behavioral predictions. This inconsistency suggests that LLM decision-making prioritizes rigid, prescriptive rules over the social sensitivity present in their internal world-modeling, which poses a gap that may lead to significant misalignments in real-world deployments. 1
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Lineage
Builds on4
- LitmusValues: Will AI Tell Lies to Save Sick Children? Litmus-Testing AI Values Prioritization with AIRiskDilemmasYu Ying Chiu, Zhilin Wang, Sharan Maiya, Yejin Choi et al.ICLR 2026 · 13 citations
- A Theory of Response Sampling in LLMs: Part Descriptive and Part PrescriptiveSarath Sivaprasad, Pramod Kaushik, Sahar Abdelnabi, Mario FritzACL 2025 · 12 citations
- Language Model Alignment in Multilingual Trolley ProblemsZhijing Jin, Max Kleiman-Weiner, Giorgio Piatti, Sydney Levine et al.ICLR 2025 · 1 citation
- Moral Outrage Shapes Commitments Beyond Attention: Multimodal Moral Emotions on YouTube in Korea and the USSeongchan Park, Jaehong Kim, Hyeonseung Kim, Heejin Bin et al.WWW 2026 · 1 citation
Related papers
- Many LLMs Are More Utilitarian Than OneAnita Keshmirian, Razan Baltaji, Babak Hemmatian, Hadi Asghari et al.NeurIPS 2025 · 10 citations
- The Staircase of Ethics: Probing LLM Value Priorities through Multi-Step Induction to Complex Moral DilemmasYa Wu, Qiang Sheng, Danding Wang, Guang Yang et al.EMNLP 2025 · 8 citations
- Do Morals Guide How LLMs Think? The Role of Ethical Perspectives in General Problem SolvingIseo Kim, Eunjin Hong, Juae KimACL 2026
- Your Mileage May Vary: How Empathy and Demographics Shape Human Preferences in LLM ResponsesYishan Wang, Amanda Cercas Curry, Flor Miriam Plaza del ArcoEMNLP Findings 2025
- Evaluating the Moral Beliefs Encoded in LLMsNino Scherrer, Claudia Shi, Amir Feder, David M. BleiNeurIPS 2023 · 316 citations
