Understanding and Supporting Online Discussion with Opinionated Chatbots
Tianqi Song, Chi-Lan Yang, Zihan Liu, Zhengtao Xu, Yibin Feng, Yi-Chieh Lee
Abstract
Opinionated chatbots are increasingly present on online platforms and have the potential to shape public discourse by influencing individuals' viewpoints before they engage in discussions. Despite their growing presence, the impact of interacting with opinionated chatbots on subsequent online interactions remains largely unexplored. This study investigated how exposure to different types of opinionated chatbots, specifically those expressing opposing, reinforcing, or balanced viewpoints, affected participants' subsequent online discussions. In a controlled experiment with 83 participants, we found that interacting with an opinionated chatbot that consistently opposed participants' arguments led to greater shifts in opinion, indicating enhanced openness to revising one's initial stance. Conversely, participants who interacted with a chatbot that consistently reinforced their views were more likely to adopt more agreeable communication styles in subsequent conversations with others. Furthermore, interactions with different types of opinionated chatbots resulted in varying levels of trust, as well as different perceptions of chatbots and human interlocutors. Our findings indicate that opinionated chatbots can influence both individuals' opinions on social topics and their communication behaviors in online environments. This presents a trade-off for future designers seeking to facilitate cognitive flexibility in changing opinions while maintaining positive user experiences and trust in the chatbots during public discourse. We discuss the implications for designing opinionated chatbots to promote more constructive and less polarized online discussions.
CCS Concepts: • Human-centered computing → Empirical studies in HCI; Empirical studies in collaborative and social computing.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d63d801d-78fd-4a36-93a9-02db005cd5b8Builds on16
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
- Co-Writing with Opinionated Language Models Affects Users' ViewsMaurice Jakesch, Advait Bhat, Daniel Buschek, Lior Zalmanson et al.CHI 2023 · 249 citations
- Bot in the Bunch: Facilitating Group Chat Discussion by Improving Efficiency and Participation with a ChatbotSoomin Kim, Jinsu Eun, Changhoon Oh, Bongwon Suh et al.CHI 2020 · 132 citations
- ArgueTutor: An Adaptive Dialog-Based Learning System for Argumentation SkillsThiemo Wambsganss, Tobias Kueng, Matthias Söllner, Jan Marco LeimeisterCHI 2021 · 126 citations
- Generative Echo Chamber? Effect of LLM-Powered Search Systems on Diverse Information SeekingNikhil Sharma, Q. Vera Liao, Ziang XiaoCHI 2024 · 123 citations
Related papers
- Exploring Effects of Chatbot's Interpretation and Self-disclosure on Mental Illness StigmaYichao Cui, Yu-Jen Lee, Jack Jamieson, Naomi Yamashita et al.CSCW 2024 · 16 citations
- User Perceptions of Extraversion in Chatbots after Repeated UseSarah Theres Völkel, Ramona Schödel, Lale Kaya, Sven MayerCHI 2022 · 37 citations
- Multi-Agents are Social Groups: Investigating Social Influence of Multiple Agents in Human-Agent InteractionsTianqi Song, Yugin Tan, Zicheng Zhu, Yibin Feng et al.CSCW 2025 · 13 citations
- Understanding How Chatbot Phrasing Styles and Care Demonstration Influence Overweight Users' Adherence Intention Towards Chatbots Supporting Weight ManagementWen-Hsuan Cheng, Yi-Chieh Lee, Jack Jamieson, Wei-Han Wang et al.CSCW 2025 · 1 citation
- Reactive Writers: How Co-Writing with AI Changes How We Engage with IdeasAdvait Bhat, Marianne Aubin Le Quéré, Mor Naaman, Maurice JakeschCHI 2026 · 5 citations
