Does My Chatbot Have an Agenda? Understanding Human and AI Agency in Human-Human-like Chatbot Interaction
Bhada Yun, Evgenia Taranova, April Yi Wang
Abstract
As AI chatbots shift from tools to companions, critical questions arise: who controls the conversation in human–AI chatrooms? This paper explores perceived human and AI agency in sustained conversation. We report a month-long longitudinal study with 22 adults who chatted with “Day”, an LLM companion we built, followed by a semi-structured interview with post-hoc elicitation of notable moments, cross-participant chat reviews, and a ‘strategy reveal’ disclosing “Day’s” goal for each conversation. We discover agency manifests as an emergent, shared experience: as participants set boundaries and the AI steered intentions, control was co-constructed turn-by-turn. We introduce a 3-by-4 framework mapping actors (Human, AI, Hybrid) by their action (Intention, Execution, Adaptation, Delimitation), modulated by individual and environmental factors. We argue for translucent design (transparency-on-demand) and provide implications for agency self-aware conversational agents.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 05e00e55-5989-41bc-a9fe-8eedfab929d4Cited by top-tier papers1
Ask how each one uses itBuilds on25
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
- Safe RLHF: Safe Reinforcement Learning from Human FeedbackJosef Dai, Xuehai Pan, Ruiyang Sun, Jiaming Ji et al.ICLR 2024 · 656 citations
- Algorithmic Folk Theories and Identity: How TikTok Users Co-Produce Knowledge of Identity and Engage in Algorithmic ResistanceNadia Karizat, Daniel Delmonaco, Motahhare Eslami, Nazanin AndalibiCSCW 2021 · 338 citations
- "I Hear You, I Feel You": Encouraging Deep Self-disclosure through a ChatbotYi-Chieh Lee, Naomi Yamashita, Yun Huang, Wai FuCHI 2020 · 333 citations
- The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI RelationshipsRenwen Zhang, Han Li, Han Meng, Jinyuan Zhan et al.CHI 2025 · 122 citations
Related papers
- Understanding Parents' Desires in Moderating Children's Interactions with GenAI Chatbots through LLM-Generated ProbesJohn Driscoll, Yulin Chen, Viki Shi, Izak Vucharatavintara et al.CHI 2026 · 2 citations
- Sensemaking in Multi-Agent LLM Interfaces: How Users Interpret Transparency and Trustworthiness CuesSaumya Pareek, Jarod Govers, Naja Kathrine Kollerup, Emily Wong et al.CHI 2026 · 1 citation
- Privacy Control in Conversational LLM Platforms: A Walkthrough StudyZhuoyang Li, Yanlai Wu, Yao Li, Xinning Gui et al.CHI 2026 · 1 citation
- Customizing Emotional Support: How Do Individuals Construct and Interact With LLM-Powered ChatbotsXi Zheng, Zhuoyang Li, Xinning Gui, Yuhan LuoCHI 2025 · 47 citations
- Retelling the News: Exploring AI-Driven Conversational News InteractionsOda Elise Nordberg, Pavel Okopnyi, Frode GuribyeCHI 2026 · 1 citation
