Are Emotion and Rhetoric Neurons in LLM? Neuron Recognition and Adaptive Masking for Emotion-Rhetoric Prediction Steering
Li Zheng, Xin Zhang, Shuyi He, Fei Li, Chong Teng, Jiang-Ming Yang, Donghong Ji, Zhuang Li
Abstract
Accurate comprehension and controllable generation of emotion and rhetoric are pivotal for enhancing the reasoning capabilities of large language models (LLMs). Existing studies mostly rely on external optimizations, lacking in-depth exploration of internal representation mechanisms, thus failing to achieve fine-grained steering at the neuron level. A handful of works on neurons are confined to emotions, neglecting rhetoric neurons and their intrinsic connections. Traditional neuron masking also exhibits counterintuitive phenomena, making reliable verification of neuron functionality infeasible. To address these issues, we systematically investigate the neurons representation mechanisms and inherent associations of 6 emotion categories and 4 core rhetorical devices. We propose a neuron identification framework that integrates multi-dimensional screening, and design an adaptive masking method incorporating dynamic filtering, attenuation masking, and feedback optimization, enabling reliable causal validation of neuron functionality.Through neuron regulation, we achieve directed induction of non-target sentences and enhancement of emotion tasks via rhetoric neurons. Experiments on 5 commonly used datasets validate the effectiveness of our method, providing a novel paradigm for the fine-grained steering of emotion and rhetoric expressions in LLMs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f4e01afb-8815-41f3-a93e-15dac8fee85eBuilds on12
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Crafting Interpretable Embeddings for Language Neuroscience by Asking LLMs QuestionsVinamra Benara, Chandan Singh, John X. Morris, Richard J. Antonello et al.NeurIPS 2024 · 26 citations
- Can Large Language Models Be Good Companions?: An LLM-Based Eyewear System with Conversational Common GroundZhenyu Xu, Hailin Xu, Zhouyang Lu, Yingying Zhao et al.UbiComp 2024 · 20 citations
- Let's Think Outside the Box: Exploring Leap-of-Thought in Large Language Models with Creative Humor GenerationShanshan Zhong, Zhongzhan Huang, Shanghua Gao, Wushao Wen et al.CVPR 2024 · 16 citations
- Reverse Multi-Choice Dialogue Commonsense Inference with Graph-of-ThoughtLi Zheng, Hao Fei, Fei Li, Bobo Li et al.AAAI 2024 · 13 citations
Related papers
- Do LLMs “Feel”? Emotion Circuits Discovery and ControlChenxi Wang, Yixuan Zhang, Ruiji Yu, Yufei Zheng et al.ICML 2026 · 11 citations
- Small Changes, Big Impact: How Manipulating a Few Neurons Can Drastically Alter LLM AggressionJaewook Lee, Junseo Jang, Oh-Woog Kwon, Harksoo KimACL 2025
- Discovering and Causally Validating Emotion-Sensitive Neurons in Large Audio-Language ModelsXiutian Zhao, Björn W. Schuller, Berrak SismanACL 2026 · 5 citations
- Neuron based Personality Trait Induction in Large Language ModelsJia Deng, Tianyi Tang, Yanbin Yin, Wenhao Yang et al.ICLR 2025
- The Good, The Bad, and Why: Unveiling Emotions in Generative AICheng Li, Jindong Wang, Yixuan Zhang, Kaijie Zhu et al.ICML 2024 · 26 citations
