Lune

EMNLP Findings2025

IntrEx: A Dataset for Modeling Engagement in Educational Conversations

Xingwei Tan, Mahathi Parvatham, Chiara Gambi, Gabriele Pergola

Abstract

Engagement and motivation are crucial for second-language acquisition, yet maintaining learner interest in educational conversations remains a challenge. While prior research has explored what makes educational texts interesting, still little is known about the linguistic features that drive engagement in conversations. To address this gap, we introduce IntrEx 1 , the first large dataset annotated for interestingness and expected interestingness in teacher-student interactions. Built upon the Teacher-Student Chatroom Corpus (TSCC), IntrEx extends prior work by incorporating sequence-level annotations, allowing for the study of engagement beyond isolated turns to capture how interest evolves over extended dialogues. We employ a rigorous annotation process with over 100 second-language learners, using a comparisonbased rating approach inspired by reinforcement learning from human feedback (RLHF) to improve agreement. We investigate whether large language models (LLMs) can predict human interestingness judgments. We find that LLMs (7B/8B parameters) fine-tuned on interestingness ratings outperform larger proprietary models like GPT-4o, demonstrating the potential for specialised datasets to model engagement in educational settings. Finally, we analyze how linguistic and cognitive factors, such as concreteness, comprehensibility (readability), and uptake, influence engagement in educational dialogues.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Multi-Objective Linguistic Control of Large Language Models cites Learning to summarize with human feedback
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on4

  1. Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
  2. Learning to summarize with human feedbackNisan Stiennon, Long Ouyang, Jeffrey Wu, Daniel M. Ziegler et al.NeurIPS 2020 · 124 citations
  3. Information Seeking in the Spirit of Learning: A Dataset for Conversational CuriosityPedro Rodriguez, Paul A. Crook, Seungwhan Moon, Zhiguang WangEMNLP 2020 · 4 citations
  4. Multi-Objective Linguistic Control of Large Language ModelsDang Nguyen, Jiuhai Chen, Tianyi ZhouACL Findings 2024 · 1 citation

Related papers

  1. BIPED: Pedagogically Informed Tutoring System for ESL EducationSoonwoo Kwon, Sojung Kim, Minju Park, Seunghyun Lee et al.ACL 2024
  2. KEEP CHATTING! An Attractive Dataset for Continuous Conversation AgentsYihe Wang, Jin Liu, Yao Wan, Yitong Li et al.ACL Findings 2024
  3. Large Language Models Know What To Say But Not When To SpeakMuhammad Umair, Vasanth Sarathy, Jan Peter de RuiterEMNLP Findings 2024 · 6 citations
  4. MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language FeedbackXingyao Wang, Zihan Wang, Jiateng Liu, Yangyi Chen et al.ICLR 2024 · 308 citations
  5. INTERS: Unlocking the Power of Large Language Models in Search with Instruction TuningYutao Zhu, Peitian Zhang, Chenghao Zhang, Yifei Chen et al.ACL 2024 · 8 citations
Dusk over the sea between two cliffs drawn in fine vertical lines