Words Like Knives: Backstory-Personalized Modeling and Detection of Violent Communication
Jocelyn J. Shen, Akhila Yerukola, Xuhui Zhou, Cynthia Breazeal, Maarten Sap, Hae-Won Park
Abstract
Conversational breakdowns in close relationships are deeply shaped by personal histories and emotional context, yet most NLP research treats conflict detection as a general task, overlooking the relational dynamics that influence how messages are perceived. In this work, we leverage nonviolent communication (NVC) theory to evaluate LLMs in detecting conversational breakdowns and assessing how relationship backstory influences both human and model perception of conflicts. Given the sensitivity and scarcity of real-world datasets featuring conflict between familiar social partners with rich personal backstories, we contribute the PERSONACONFLICTS CORPUS 1 , a dataset of N = 5, 772 naturalistic simulated dialogues spanning diverse conflict scenarios between friends, family members, and romantic partners. Through a controlled human study, we annotate a subset of dialogues and obtain finegrained labels of communication breakdown types on individual turns, and assess the impact of backstory on human and model perception of conflict in conversation. We find that the polarity of relationship backstories significantly shifted human perception of communication breakdowns and impressions of the social partners, yet models struggle to meaningfully leverage those backstories in the detection task. Additionally, we find that models consistently overestimate how positively a message will make a listener feel. Our findings underscore the critical role of personalization to relationship contexts in enabling LLMs to serve as effective mediators in human communication for authentic connection.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3356a569-ef4f-4581-9a0b-c88b736bcb20Cited by top-tier papers1
Ask how each one uses itBuilds on11
- SOTOPIA: Interactive Evaluation for Social Intelligence in Language AgentsXuhui Zhou, Hao Zhu, Leena Mathur, Ruohong Zhang et al.ICLR 2024 · 288 citations
- Conversations Gone Alright: Quantifying and Predicting Prosocial Outcomes in Online ConversationsJiajun Bao, Junjie Wu, Yiming Zhang, Eshwar Chandrasekharan et al.WWW 2021 · 63 citations
- Quantifying the Persona Effect in LLM SimulationsTiancheng Hu, Nigel CollierACL 2024 · 22 citations
- Social Bias Frames: Reasoning about Social and Power Implications of LanguageMaarten Sap, Saadia Gabriel, Lianhui Qin, Dan Jurafsky et al.ACL 2020 · 16 citations
- A Synthetic Data Generation Framework for Grounded DialoguesJianzhu Bao, Rui Wang, Yasheng Wang, Aixin Sun et al.ACL 2023 · 11 citations
Related papers
- Your spouse needs professional help: Determining the Contextual Appropriateness of Messages through Modeling Social RelationshipsDavid Jurgens, Agrima Seth, Jackson Sargent, Athena Aghighi et al.ACL 2023 · 4 citations
- Unifying Data Perspectivism and Personalization: An Application to Social NormsJoan Plepi, Béla Neuendorf, Lucie Flek, Charles WelchEMNLP 2022 · 4 citations
- Leveraging Conflicts in Social Media Posts: Unintended Offense DatasetChe-Wei Tsai, Yen-Hao Huang, Tsu-Keng Liao, Didier Estrada et al.EMNLP 2024
- Evaluating Intention Detection Capability of Large Language Models in Persuasive DialoguesHiromasa Sakurai, Yusuke MiyaoACL 2024
- Ten Social Dimensions of Conversations and RelationshipsMinje Choi, Luca Maria Aiello, Krisztián Zsolt Varga, Daniele QuerciaWWW 2020 · 58 citations
