A Checks-and-Balances Framework for Context-Aware Ethical AI Alignment
Edward Y. Chang
摘要
This paper introduces a checks-and-balances framework for ethical alignment of Large Language Models (LLMs), inspired by three-branch governmental systems. It implements three independent yet interacting components: LLMs as the executive branch for knowledge generation, Dike as the legislative branch that establishes ethical guardrails, and Eris as the judicial branch for contextual interpretation. Beyond structural separation, we address a fundamental challenge: regulating emotion to shape behaviors. Drawing from psychological theories where managing emotional responses prevents harmful behaviors, we develop a self-supervised learning pipeline that maps emotions to linguistic behaviors, enabling precise behavioral modulation through emotional conditioning. By integrating this approach with adversarial testing, our framework demonstrates how Dike and Eris direct linguistic behaviors toward ethical outcomes while preserving independence throughout knowledge generation, ethical oversight, and contextual interpretation.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper6
- Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning 等NeurIPS 2023 · 被引用 10,924 次
- Model Alignment as Prospect Theoretic OptimizationKawin Ethayarajh, Winnie Xu, Niklas Muennighoff, Dan Jurafsky 等ICML 2024 · 被引用 973 次
- RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI FeedbackHarrison Lee, Samrat Phatale, Hassan Mansoor, Thomas Mesnard 等ICML 2024 · 被引用 598 次
- Generalized Preference Optimization: A Unified Approach to Offline AlignmentYunhao Tang, Zhaohan Daniel Guo, Zeyu Zheng, Daniele Calandriello 等ICML 2024 · 被引用 159 次
- Mitigating the Alignment Tax of RLHFYong Lin, Hangyu Lin, Wei Xiong, Shizhe Diao 等EMNLP 2024 · 被引用 18 次
相关 Paper
- EAI: Emotional Decision-Making of LLMs in Strategic Games and Ethical DilemmasMikhail Mozikov, Nikita Severin, Valeria Bodishtianu, Maria Glushanina 等NeurIPS 2024 · 被引用 21 次
- Between a Rock and a Hard Place: The Tension Between Ethical Reasoning and Safety Alignment in LLMsShei Pern Chua, Zhen Leng Thai, Kai Jun Teh, Xiao Li 等ACL 2026
- Feeling Rules in Language Models: Mapping Norms of Emotional Appropriateness Across Roles, Institutions, and IntensityGuangrui Fan, Dandan Liu, Aznul Qalid Md Sabri, Rui Zhang 等ACL 2026
- Emergence of Hierarchical Emotion Organization in Large Language ModelsMaya Okawa, Bo Zhao, Eric Bigelow, Rose Yu 等ICML 2026 · 被引用 4 次
- Model Editing as a Double-Edged Sword: Steering Agent Behavior Toward Beneficence or HarmBaixiang Huang, Zhen Tan, Haoran Wang, Zijie Liu 等AAAI 2026
