Understanding Parents' Desires in Moderating Children's Interactions with GenAI Chatbots through LLM-Generated Probes
John Driscoll, Yulin Chen, Viki Shi, Izak Vucharatavintara, Yaxing Yao, Haojian Jin
Abstract
This paper studies how parents want to moderate children’s interactions with Generative AI Chatbots, with the goal of informing the design of future GenAI parental control tools. We first used an LLM to generate synthetic Child–GenAI Chatbot interaction scenarios and worked with four parents to validate their realism. From this dataset, we carefully selected 12 diverse examples that evoked varying levels of concern and were rated the most realistic. Each example included a prompt and GenAI Chatbot response. We presented these to parents (N=24) and asked whether they found them concerning, why, and how they would prefer to modify the responses and be informed. Our findings reveal three key insights: (1) parents express concern about interactions that current GenAI Chatbot parental controls neglect; (2) parents want fine-grained transparency and moderation at the conversation level; and (3) parents need personalized controls that adapt to their desired strategies and children’s ages.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6294a42b-6c8a-4ba1-a463-d44db138894cCited by top-tier papers1
Ask how each one uses itBuilds on11
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Generative Agents: Interactive Simulacra of Human BehaviorJoon Sung Park, Joseph C. O'Brien, Carrie Jun Cai, Meredith Ringel Morris et al.UIST 2023 · 1,882 citations
- Take a Step Back: Evoking Reasoning via Abstraction in Large Language ModelsHuaixiu Steven Zheng, Swaroop Mishra, Xinyun Chen, Heng-Tze Cheng et al.ICLR 2024 · 216 citations
- Decomposed Prompting: A Modular Approach for Solving Complex TasksTushar Khot, Harsh Trivedi, Matthew Finlayson, Yao Fu et al.ICLR 2023 · 94 citations
Related papers
- Exploring Parent-Child Perceptions on Safety in Generative AI: Concerns, Mitigation Strategies, and Design ImplicationsYaman Yu, Tanusree Sharma, Melinda Hu, Justin Wang et al.S&P 2025
- Generative AI in Children's Creative Collaboration: Impact, Perception, and Design GuidelinesDaeun Yoo, Michele Newman, Caroline Pitt, Kevin Huu Vo et al.CHI 2026 · 1 citation
- Malicious LLM-Based Conversational AI Makes Users Reveal Personal InformationXiao Zhan, Juan Carlos Carrillo, William Seymour, Jose SuchUSENIX Security 2025
- Does My Chatbot Have an Agenda? Understanding Human and AI Agency in Human-Human-like Chatbot InteractionBhada Yun, Evgenia Taranova, April Yi WangCHI 2026 · 3 citations
- The Impact of Security and Privacy Controls on Users' Emotional Engagement with Generative AI ChatbotsJabari Kwesi, Jiaxun Cao, Hailee Cunningham, Pardis Emami-NaeiniUSENIX Security 2026 · 2 citations
