Exploring User Security and Privacy Attitudes and Concerns Toward the Use of General-Purpose LLM Chatbots for Mental Health
Jabari Kwesi, Jiaxun Cao, Riya Manchanda, Pardis Emami Naeini
摘要
Individuals are increasingly relying on large language model (LLM)-enabled conversational agents for emotional support. While prior research has examined privacy and security issues in chatbots specifically designed for mental health purposes, these chatbots are overwhelmingly"rule-based"offerings that do not leverage generative AI. Little empirical research currently measures users'privacy and security concerns, attitudes, and expectations when using general-purpose LLM-enabled chatbots to manage and improve mental health. Through 21 semi-structured interviews with U.S. participants, we identified critical misconceptions and a general lack of risk awareness. Participants conflated the human-like empathy exhibited by LLMs with human-like accountability and mistakenly believed that their interactions with these chatbots were safeguarded by the same regulations (e.g., HIPAA) as disclosures with a licensed therapist. We introduce the concept of"intangible vulnerability,"where emotional or psychological disclosures are undervalued compared to more tangible forms of information (e.g., financial or location-based data). To address this, we propose recommendations to safeguard user mental health disclosures with general-purpose LLM-enabled chatbots more effectively.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper5
- The Impact of Security and Privacy Controls on Users' Emotional Engagement with Generative AI ChatbotsJabari Kwesi, Jiaxun Cao, Hailee Cunningham, Pardis Emami-NaeiniUSENIX Security 2026 · 被引用 2 次
- More than Decision Support: Exploring Patients' Longitudinal Usage of Large Language Models in Real-World Healthcare-Seeking JourneysYancheng Cao, Yishu Ji, Chris Yue Fu, Sahiti Dharmavaram 等CHI 2026 · 被引用 2 次
- Privacy and Safety Experiences and Concerns of US Women Using Generative AI for Seeking Sexual and Reproductive Health InformationIna Kaleva, Xiao Zhan, Ruba Abu-Salma, Jose SuchCHI 2026 · 被引用 1 次
- The Privacy Paradox of LLMs: User Perceptions and the Reality of PII LeakageShuai Cheng, Haitao Xu, Shu Meng, Shuai Hao 等CHI 2026
- What Users Ask, Policies Miss: Unveiling the Gap Between Community-Expressed Privacy Concerns and LLM Provider PoliciesZhihuang Liu, Zhen Huang, Ling Hu, Yifan Yang 等USENIX Security 2026
它引用的顶会 Paper5
- "I Hear You, I Feel You": Encouraging Deep Self-disclosure through a ChatbotYi-Chieh Lee, Naomi Yamashita, Yun Huang, Wai FuCHI 2020 · 被引用 333 次
- Designing a Chatbot as a Mediator for Promoting Deep Self-Disclosure to a Real Mental Health ProfessionalYi-Chieh Lee, Naomi Yamashita, Yun HuangCSCW 2020 · 被引用 190 次
- "It's the Company, the Government, You and I": User Perceptions of Responsibility for Smart Home Privacy and SecurityJulie M. Haney, Yasemin Acar, Susanne FurmanUSENIX Security 2021 · 被引用 49 次
- The Typing Cure: Experiences with Large Language Model Chatbots for Mental Health SupportInhwa Song, Sachin R. Pendse, Neha Kumar, Munmun De ChoudhuryCSCW 2025 · 被引用 41 次
- Cognitive Reframing of Negative Thoughts through Human-Language Model InteractionAshish Sharma, Kevin Rushton, Inna E. Lin, David Wadden 等ACL 2023 · 被引用 32 次
相关 Paper
- Prevalence Overshadows Concerns? Understanding Chinese Users' Privacy Awareness and Expectations Towards LLM-Based Healthcare ConsultationZhihuang Liu, Ling Hu, Tongqing Zhou, Yonghao Tang 等S&P 2025
- A Conditional Companion: Lived Experiences of People with Mental Health Disorders Using LLMs: Conditional Companion: LLMs & Mental HealthAditya Kumar Purohit, Hendrik HeuerCHI 2026 · 被引用 3 次
- Malicious LLM-Based Conversational AI Makes Users Reveal Personal InformationXiao Zhan, Juan Carlos Carrillo, William Seymour, Jose SuchUSENIX Security 2025
- "It's a Fair Game", or Is It? Examining How Users Navigate Disclosure Risks and Benefits When Using LLM-Based Conversational AgentsZhiping Zhang, Michelle Jia, Hao-Ping (Hank) Lee, Bingsheng Yao 等CHI 2024 · 被引用 92 次
- 'I've talked to ChatGPT about my issues last night.': Examining Mental Health Conversations with Large Language Models through Reddit AnalysisKyuha Jung, Gyuho Lee, Yuanhui Huang, Yunan ChenCSCW 2025 · 被引用 23 次
