Exploring Parent-Child Perceptions on Safety in Generative AI: Concerns, Mitigation Strategies, and Design Implications
Yaman Yu, Tanusree Sharma, Melinda Hu, Justin Wang, Yang Wang
Abstract
The widespread use of Generative Artificial Intelligence (GAI) among teenagers has led to significant misuse and safety concerns. To identify risks and understand parental controls challenges, we conducted a content analysis on Reddit and interviewed 20 participants (seven teenagers and 13 parents). Our study reveals a significant gap in parental awareness of the extensive ways children use GAI, such as interacting with character-based chatbots for emotional support or engaging in virtual relationships. Parents and children report differing perceptions of risks associated with GAI. Parents primarily express concerns about data collection, misinformation, and exposure to inappropriate content. In contrast, teenagers are more concerned about becoming addicted to virtual relationships with GAI, the potential misuse of GAI to spread harmful content in social groups, and the invasion of privacy due to unauthorized use of their personal data in GAI applications. The absence of parental control features on GAI platforms forces parents to rely on system-built controls, manually check histories, share accounts, and engage in active mediation. Despite these efforts, parents struggle to grasp the full spectrum of GAI-related risks and to perform effective real-time monitoring, mediation, and education. We provide design recommendations to improve parent-child communication and enhance the safety of GAI use.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 937cc089-a774-4438-be35-6421346ef97bCited by top-tier papers13
- SET-PAiREd: Designing for Parental Involvement in Learning with an AI-Assisted Educational RobotHui-Ru Ho, Nitigya Kargeti, Ziqi Liu, Bilge MutluCHI 2025 · 27 citations
- Understanding Teen Overreliance on AI Companion Chatbots Through Self-Reported Reddit NarrativesMohammad (Matt) Namvarpour, Brandon Brofsky, Jessica Y. Medina, Mamtaj Akter et al.CHI 2026 · 19 citations
- Benchmarking and Understanding Safety Risks in AI Character PlatformsYiluo Wei, Peixian Zhang, Gareth TysonNDSS 2026 · 4 citations
- Principles of Safe AI Companions for Youth: Parent and Expert PerspectivesYaman Yu, Mohi, Aishi Debroy, Xin Cao et al.CHI 2026 · 3 citations
- Families' Vision of Generative AI Agents for Household Safety Against Digital and Physical ThreatsZikai Wen, Lanjing Liu, Yaxing YaoCSCW 2025 · 3 citations
Builds on14
- "It's a Fair Game", or Is It? Examining How Users Navigate Disclosure Risks and Benefits When Using LLM-Based Conversational AgentsZhiping Zhang, Michelle Jia, Hao-Ping (Hank) Lee, Bingsheng Yao et al.CHI 2024 · 92 citations
- Informing Age-Appropriate AI: Examining Principles and Practices of AI for ChildrenGe Wang, Jun Zhao, Max Van Kleek, Nigel ShadboltCHI 2022 · 73 citations
- Deepfakes, Phrenology, Surveillance, and More! A Taxonomy of AI Privacy RisksHao-Ping (Hank) Lee, Yu-Ju Yang, Thomas Serban Von Davier, Jodi Forlizzi et al.CHI 2024 · 73 citations
- From Parental Control to Joint Family Oversight: Can Parents and Teens Manage Mobile Online Safety and Privacy as Equals?Mamtaj Akter, Amy J. Godfrey, Jess Kropczynski, Heather Richter Lipford et al.CSCW 2022 · 64 citations
- Protection or Punishment? Relating the Design Space of Parental Control Apps and Perceptions about Them to Support Parenting for Online SafetyGe Wang, Jun Zhao, Max Van Kleek, Nigel ShadboltCSCW 2021 · 63 citations
Related papers
- Understanding Parents' Desires in Moderating Children's Interactions with GenAI Chatbots through LLM-Generated ProbesJohn Driscoll, Yulin Chen, Viki Shi, Izak Vucharatavintara et al.CHI 2026 · 2 citations
- Rehearsing the Self with AI: Teens Cross-Domain Use of ChatbotsCora Sula, Umama Dewan, Nora McDonaldCHI 2026 · 1 citation
- The AI Genie Phenomenon and Three Types of AI Chatbot Addiction: Escapist Roleplays, Pseudosocial Companions, and Epistemic Rabbit HolesM. Karen Shen, Jessica Huang, Olivia Liang, Ig-Jae Kim et al.CHI 2026 · 6 citations
- Mental Health Impacts of AI Companions: Triangulating Social Media Quasi-Experiments, User Perspectives, and Relational LensYunhao Yuan, Jiaxun Zhang, Talayeh Aledavood, Renwen Zhang et al.CHI 2026 · 8 citations
- The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI RelationshipsRenwen Zhang, Han Li, Han Meng, Jinyuan Zhan et al.CHI 2025 · 122 citations
