How Should AI Systems Talk to Users when Collecting their Personal Information? Effects of Role Framing and Self-Referencing on Human-AI Interaction
Mengqi Liao, S. Shyam Sundar
Abstract
AI systems collect our personal information in order to provide personalized services, raising privacy concerns and making users leery. As a result, systems have begun emphasizing overt over covert collection of information by directly asking users. This poses an important question for ethical interaction design, which is dedicated to improving user experience while promoting informed decision-making: Should the interface tout the benefits of information disclosure and frame itself as a help-provider? Or, should it appear as a help-seeker? We decided to find out by creating a mockup of a news recommendation system called Mindz and conducting an online user study (N=293) with the following four variations: AI system as help seeker vs. help provider vs. both vs. neither. Data showed that even though all participants received the same recommendations, power users tended to trust a help-seeking Mindz more whereas non-power users favored one that is both help-seeker and help-provider.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Cited by top-tier papers2
- Towards AI as Colleagues: Multi-Agent System Improves Structured Ideation ProcessesKexin Quan, Dina Albassam, Mengke Wu, Zijian Ding et al.CHI 2026 · 2 citations
- "Impressively Scary: ' Exploring User Perceptions and Reactions to Unraveling Machine Learning Models in Social Media ApplicationsJack West, Bengisu Cagiltay, Shirley Zhang, Jingjie Li et al.CHI 2025 · 2 citations
Related papers
- Agency Aspirations: Understanding Users' Preferences And Perceptions Of Their Role In Personalised News CurationAnna Marie Rezk, Auste Simkute, Ewa Luger, John Vines et al.CHI 2024 · 10 citations
- Rethinking User Empowerment in AI Recommender System: Innovating Transparent and Controllable InterfacesMengke Wu, Weizi Liu, Yanyun Wang, Weiyu Ding et al.CHI 2026 · 3 citations
- Capable but Amoral? Comparing AI and Human Expert Collaboration in Ethical Decision MakingSuzanne Tolmeijer, Markus Christen, Serhiy Kandul, Markus Kneer et al.CHI 2022 · 68 citations
- The Effects of Warmth and Competence Perceptions on Users' Choice of an AI SystemZohar Gilad, Ofra Amir, Liat LevontinCHI 2021 · 54 citations
- Futuring Social Assemblages: How Enmeshing AIs into Social Life Challenges the Individual and the InterpersonalLingqing Wang, Yingting Gao, Chidimma Lois Anyi, Ashok K. GoelCHI 2026 · 2 citations
