StorySparkQA: Expert-Annotated QA Pairs with Real-World Knowledge for Children's Story-Based Learning
Jiaju Chen, Yuxuan Lu, Shao Zhang, Bingsheng Yao, Yuanzhe Dong, Ying Xu, Yunyao Li, Qianwen Wang, Dakuo Wang, Yuling Sun
Abstract
Interactive story reading is common in early childhood education, where teachers expect to teach both language skills and real-world knowledge beyond the story. While many story reading systems have been developed for this activity, they often fail to infuse real-world knowledge into the conversation. This limitation can be attributed to the existing questionanswering (QA) datasets used for children's education, upon which the systems are built, failing to capture the nuances of how education experts think when conducting interactive story reading activities. To bridge this gap, we design an annotation framework, empowered by existing knowledge graph to capture experts' annotations and thinking process, and leverage this framework to construct StorySparkQA dataset, which comprises 5, 868 expert-annotated QA pairs with real-world knowledge. We conduct automated and human expert evaluations across various QA pair generation settings to demonstrate that our StorySparkQA can effectively support models in generating QA pairs that target real-world knowledge beyond story content. StorySparkQA 1 is available at https://huggingface.co/ datasets/NEU-HAI/StorySparkQA .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers5
- Multi-Agent-as-Judge: Aligning LLM-Agent-Based Automated Evaluation with Multi-Dimensional Human EvaluationJiaju Chen, Yuxuan Lu, Xiaojie Wang, Huimin Zeng et al.ACL 2026 · 30 citations
- Characterizing LLM-Empowered Personalized Story Reading and Interaction for Children: Insights From Multi-Stakeholder PerspectivesJiaju Chen, Minglong Tang, Yuxuan Lu, Bingsheng Yao et al.CHI 2025 · 20 citations
- Critical Confabulation: Can LLMs Hallucinate for Social Good?Peiqi Sui, Eamon Duede, Hoyt Long, Richard Jean SoICLR 2026 · 2 citations
- SparkTales: Facilitating Cross-Language Collaborative Storytelling through Coordinator-AI CollaborationWenxin Zhao, Peng Zhang, Hansu Gu, Haoxuan Zhou et al.CHI 2026 · 1 citation
- PAPEL: A Collaborative System for Parental Guidance during Preschool Play-Based English LearningXutong Wang, Yu Mei, Qinwei Li, Muyu Liu et al.CSCW 2026
Builds on9
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text DataXuhai Xu, Bingsheng Yao, Yuanzhe Dong, Saadia Gabriel et al.UbiComp 2024 · 281 citations
- StoryBuddy: A Human-AI Collaborative Chatbot for Parent-Child Interactive Storytelling with Flexible Parental InvolvementZheng Zhang, Ying Xu, Yanhao Wang, Bingsheng Yao et al.CHI 2022 · 168 citations
- Fantastic Questions and Where to Find Them: FairytaleQA - An Authentic Dataset for Narrative ComprehensionYing Xu, Dakuo Wang, Mo Yu, Daniel Ritchie et al.ACL 2022 · 131 citations
Related papers
- It is AI's Turn to Ask Humans a Question: Question-Answer Pair Generation for Children's Story BooksBingsheng Yao, Dakuo Wang, Tongshuang Wu, Zheng Zhang et al.ACL 2022 · 58 citations
- Educational Question Generation of Children Storybooks via Question Type Distribution Learning and Event-centric SummarizationZhenjie Zhao, Yufang Hou, Dakuo Wang, Mo Yu et al.ACL 2022 · 50 citations
- Enhanced Story Comprehension for Large Language Models through Dynamic Document-Based Knowledge GraphsBerkeley R. Andrus, Yeganeh Nasiri, Shilong Cui, Benjamin Cullen et al.AAAI 2022 · 46 citations
- AI-VQA: Visual Question Answering based on Agent Interaction with InterpretabilityRengang Li, Cong Xu, Zhenhua Guo, Baoyu Fan et al.ACM MM 2022 · 7 citations
- Can LLMs Evaluate Complex Attribution in QA? Automatic Benchmarking using Knowledge GraphsNan Hu, Jiaoyan Chen, Yike Wu, Guilin Qi et al.ACL 2025
