Assessing the Helpfulness of Learning Materials with Inference-Based Learner-Like Agent
Yun-Hsuan Jen, Chieh-Yang Huang, Mei-Hua Chen, Ting-Hao 'Kenneth' Huang, Lun-Wei Ku
Abstract
Many English-as-a-second language learners have trouble using near-synonym words (e.g., small vs. little; briefly vs. shortly) correctly, and often look for example sentences to learn how two nearly synonymous terms differ. Prior work uses hand-crafted scores to recommend sentences but have difficulty in adopting such scores to all the near-synonyms as near-synonyms differ in various ways. We notice that the helpfulness of the learning material would reflect on the learners' performance. Thus, we propose the inference-based learner-like agent to mimic learner behavior and identify good learning materials by examining the agent's performance. To enable the agent to behave like a learner, we leverages entailment modeling's capability of inferring answers from the provided materials. Experimental results show that the proposed agent is equipped with good learner-like behavior to achieve the best performance in both fill-inthe-blank (FITB) and good example sentence selection tasks. We further conduct a classroom user study with college ESL learners. The results of the user study show that the proposed agent can find out example sentences that help students learn more easily and efficiently. Compared to other models, the proposed agent improves the score of more than 17% of students after learning.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Related papers
- EA-Agent: A Structured Multi-Step Reasoning Agent for Entity AlignmentYixuan Nan, Xixun Lin, Yanmin Shang, Ge Zhang et al.ACL 2026
- AlignUSER: Human-Aligned LLM Agents via World Models for Recommender System EvaluationNicolas Bougie, Gian Maria Marconi, Xiaotong Ye, Narimawa WatanabeACL 2026 · 3 citations
- MGFRec: Towards Reinforced Reasoning Recommendation with Multiple Groundings and FeedbackShihao Cai, Chongming Gao, Haoyan Liu, Wentao Shi et al.KDD 2026
- Interpretability for Language Learners Using Example-Based Grammatical Error CorrectionMasahiro Kaneko, Sho Takase, Ayana Niwa, Naoaki OkazakiACL 2022
- IntrAgent: An LLM Agent for Content-Grounded Information Retrieval through Literature ReviewFengbo Ma, Zixin Rao, Xiaoting Li, Zhetao Chen et al.ACL 2026 · 2 citations
