Lune

ACL Findings2026

Imperfectly Cooperative Human-AI Interactions: Comparing the Impacts of Human and AI Attributes in Simulated and User Studies

Myke C. Cohen, Mingqian Zheng, Neel Bhandari, Hsien-Te Kao, Xuhui Zhou, Daniel Nguyen, Laura Cassani, Maarten Sap, Svitlana Volkova

Abstract

AI design characteristics and human personality traits each impact the quality and outcomes of human-AI interactions. However, their relative and joint impacts are underexplored in imperfectly cooperative scenarios, where people and AI only have partially aligned goals and objectives. This study compares a purely simulated dataset comprising 2,000 simulations and a parallel human subjects experiment involving 290 human participants to investigate these effects across two scenario categories: (1) hiring negotiations between human job candidates and AI hiring agents; and (2) human-AI transactions wherein AI agents may conceal information to maximize internal goals. We examine user Extraversion and Agreeableness alongside AI design characteristics, including Adaptability, Expertise, and chain-of-thought Transparency. Our causal discovery analysis extends performance-focused evaluations by integrating scenario-based outcomes, communication analysis, and questionnaire measures. Results reveal divergences between purely simulated and human study datasets, and between scenario types. In simulation experiments, personality traits and AI attributes were comparatively influential. Yet, with actual human subjects, AI attributes-particularly transparencywere much more impactful. We discuss how these divergences vary across different interaction contexts, offering crucial insights for the future of human-centered AI agents.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents cites Social Simulacra: Creating Populated Prototypes for Social Computing Systems
  • Can Large Language Model Agents Simulate Human Trust Behavior? cites SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on14

  1. Building Cooperative Embodied Agents Modularly with Large Language ModelsHongxin Zhang, Weihua Du, Jiaming Shan, Qinhong Zhou et al.ICLR 2024 · 303 citations
  2. SOTOPIA: Interactive Evaluation for Social Intelligence in Language AgentsXuhui Zhou, Hao Zhu, Leena Mathur, Ruohong Zhang et al.ICLR 2024 · 288 citations
  3. DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement LearningHao Bai, Yifei Zhou, Jiayi Pan, Mert Cemri et al.NeurIPS 2024 · 239 citations
  4. Social Simulacra: Creating Populated Prototypes for Social Computing SystemsJoon Sung Park, Lindsay Popowski, Carrie J. Cai, Meredith Ringel Morris et al.UIST 2022 · 192 citations
  5. Can Large Language Model Agents Simulate Human Trust Behavior?Chengxing Xie, Canyu Chen, Feiran Jia, Ziyu Ye et al.NeurIPS 2024 · 183 citations

Related papers

  1. Human-AI Collaboration in a Cooperative Game Setting: Measuring Social Perception and OutcomesZahra Ashktorab, Q. Vera Liao, Casey Dugan, James Johnson et al.CSCW 2020 · 79 citations
  2. How Personality Traits Influence Negotiation Outcomes? A Simulation based on Large Language ModelsYin Jou Huang, Rafik HadfiEMNLP Findings 2024 · 3 citations
  3. Being Trustworthy is Not Enough: How Untrustworthy Artificial Intelligence (AI) Can Deceive the End-Users and Gain Their TrustNikola Banovic, Zhuoran Yang, Aditya Ramesh, Alice LiuCSCW 2023 · 54 citations
  4. Chameleon LLMs: User Personas Influence Chatbot Personality ShiftsJane Xing, Tianyi Niu, Shashank SrivastavaEMNLP 2025
  5. Skin-Deep Bias: How Avatar Appearances Shape Perceptions of AI HiringKa Hei Carrie Lau, Philipp Stark, Efe Bozkir, Enkelejda KasneciCHI 2026 · 1 citation
Dusk over the sea between two cliffs drawn in fine vertical lines