Lune

EMNLP Findings2023

Measure Children's Mindreading Ability with Machine Reading

Yuliang Yan, Xiaohua Wang, Xiang Zhou, Xiaoqing Zheng, Xuanjing Huang

Abstract

Recently, much research in psychology has benefited from the advances in machine learning techniques. Some recent studies showed that it is possible to build automated scoring models for children's mindreading. These models were trained on a set of manually-labeled question-response pairs, which were collected by asking children to answer one or two questions after a short story is told or a video clip is played. However, existing models did not take the features of the stories and video clips into account when scoring, which obviously will reduce the accuracy of the scoring models. Furthermore, considering that different psychological tests may contain the same questions, this approach cannot be extended to other related psychological test datasets. In this study, we proposed a multi-modal learning framework to leverage the features extracted from the stories and videos related to the questions being asked during the children's mindreading evaluation. Experimental results show that the scores produced by the proposed models agree well with those graded by human experts, highlighting the potential of the proposed network architecture for practical automated children's mindreading scoring systems 1 .

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Builds on1

  1. Can vectors read minds better than experts? Comparing data augmentation strategies for the automated scoring of children's mindreading abilityVenelin Kovatchev, Phillip Smith, Mark G. Lee, Rory T. DevineACL 2021

Related papers

  1. MMR-V: What's Left Unsaid? A Benchmark for Multimodal Deep Reasoning in VideosKejian Zhu, Zhuoran Jin, Hongbang Yuan, Jiachun Li et al.ICLR 2026 · 22 citations
  2. Towards Better Forecasting by Fusing Near and Distant Future VisionsJiezhu Cheng, Kaizhu Huang, Zibin ZhengAAAI 2020 · 58 citations
  3. Assessing Modality Bias in Video Question Answering Benchmarks with Multimodal Large Language ModelsJean Park, Kuk Jin Jang, Basam Alasaly, Sriharsha Mopidevi et al.AAAI 2025 · 21 citations
  4. PgM: Partitioner Guided Modal Learning FrameworkGuimin Hu, Yi Xin, Lijie Hu, Zhihong Zhu et al.ACM MM 2025 · 1 citation
  5. AutoM3L: An Automated Multimodal Machine Learning Framework with Large Language ModelsDaqin Luo, Chengjian Feng, Yuxuan Nong, Yiqing ShenACM MM 2024 · 16 citations
Dusk over the sea between two cliffs drawn in fine vertical lines