Informing Age-Appropriate AI: Examining Principles and Practices of AI for Children
Ge Wang, Jun Zhao, Max Van Kleek, Nigel Shadbolt
Abstract
AI systems are becoming increasingly pervasive within children's devices, apps, and services. However, it is not yet well-understood how risks and ethical considerations of AI relate to children. This paper makes three contributions to this area: first, it identifies ten areas of alignment between general AI frameworks and codes for age-appropriate design for children. Then, to understand how such principles relate to real application contexts, we conducted a landscape analysis of children's AI systems, via a systematic literature review including 188 papers. This analysis revealed a wide assortment of applications, and that most systems' designs addressed only a small subset of principles among those we identified. Finally, we synthesised our findings in a framework to inform a new "Code for Age-Appropriate AI", which aims to provide timely input to emerging policies and standards, and inspire increased interactions between the AI and child-computer interaction communities.
• General and reference → Surveys and overviews; • Humancentered computing → HCI theory, concepts and models; Empirical studies in HCI.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers10
- Understanding Design Collaboration Between Designers and Artificial Intelligence: A Systematic Literature ReviewYang Shi, Tian Gao, Xiaohan Jiao, Nan CaoCSCW 2023 · 170 citations
- "When He Feels Cold, He Goes to the Seahorse" - Blending Generative AI into Multimaterial Storymaking for Family Expressive Arts TherapyDi Liu, Hanqing Zhou, Pengcheng AnCHI 2024 · 35 citations
- 12 Ways to Empower: Designing for Children's Digital AutonomyGe Wang, Jun Zhao, Max Van Kleek, Nigel ShadboltCHI 2023 · 34 citations
- SET-PAiREd: Designing for Parental Involvement in Learning with an AI-Assisted Educational RobotHui-Ru Ho, Nitigya Kargeti, Ziqi Liu, Bilge MutluCHI 2025 · 27 citations
- Exploring Parent's Needs for Children-Centered AI to Support Preschoolers' Interactive Storytelling and Reading ActivitiesYuling Sun, Jiaju Chen, Bingsheng Yao, Jiali Liu et al.CSCW 2024 · 27 citations
Builds on8
- What is AI Literacy? Competencies and Design ConsiderationsDuri Long, Brian MagerkoCHI 2020 · 2,947 citations
- A Human-Centered Review of Algorithms used within the U.S. Child Welfare SystemDevansh Saxena, Karla A. Badillo-Urquiola, Pamela J. Wisniewski, Shion GuhaCHI 2020 · 114 citations
- Circle of Trust: A New Approach to Mobile Online Safety for FamiliesArup Kumar Ghosh, Charles E. Hughes, Pamela J. WisniewskiCHI 2020 · 73 citations
- What Are You Talking To?: Understanding Children's Perceptions of Conversational AgentsYing Xu, Mark WarschauerCHI 2020 · 70 citations
- Actionable UI Design Guidelines for Smartphone Applications Inclusive of Low-Literate UsersAyushi Srivastava, Shivani Kapania, Anupriya Tuli, Pushpendra SinghCSCW 2021 · 60 citations
Related papers
- "Money makes the world go around": Identifying Barriers to Better Privacy in Children's Apps From Developers' PerspectivesAnirudh Ekambaranathan, Jun Zhao, Max Van KleekCHI 2021 · 41 citations
- Who Gets to Define Safety? A Systematic Review of How Generative AI Research Addresses Youth Online SafetyOzioma Collins Oguine, Adriana Alvarado Garcia, Michael J. Muller, Karla Badillo-UrquiolaCHI 2026 · 2 citations
- The Last Decade of HCI Research on Children and Voice-based Conversational AgentsRadhika Garg, Hua Cui, Spencer Seligson, Bo Zhang et al.CHI 2022 · 71 citations
- Bridging AI and Humanitarianism: An HCI-Informed Framework for Responsible AI AdoptionTigmanshu Bhatnagar, Maarya Omar, Davor Orlic, James Smith et al.CHI 2025 · 4 citations
- What is Human-Centered about Human-Centered AI? A Map of the Research LandscapeTara Capel, Margot BreretonCHI 2023 · 218 citations
