Gated Convolutional Bidirectional Attention-based Model for Off-topic Spoken Response Detection
Yefei Zha, Ruobing Li, Hui Lin
Abstract
Off-topic spoken response detection, the task aiming at predicting whether a response is offtopic for the corresponding prompt, is important for an automated speaking assessment system. In many real-world educational applications, off-topic spoken response detectors are required to achieve high recall for off-topic responses not only on seen prompts but also on prompts that are unseen during training. In this paper, we propose a novel approach for offtopic spoken response detection with high offtopic recall on both seen and unseen prompts. We introduce a new model, Gated Convolutional Bidirectional Attention-based Model (GCBiA), which applies bi-attention mechanism and convolutions to extract topic words of prompts and key-phrases of responses, and introduces gated unit and residual connections between major layers to better represent the relevance of responses and prompts. Moreover, a new negative sampling method is proposed to augment training data. Experiment results demonstrate that our novel approach can achieve significant improvements in detecting off-topic responses with extremely high ontopic recall, for both seen and unseen prompts.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Related papers
- CORA: Adapting CLIP for Open-Vocabulary Detection with Region Prompting and Anchor Pre-MatchingXiaoshi Wu, Feng Zhu, Rui Zhao, Hongsheng LiCVPR 2023
- ConceptBeam: Concept Driven Target Speech ExtractionYasunori Ohishi, Marc Delcroix, Tsubasa Ochiai, Shoko Araki et al.ACM MM 2022 · 18 citations
- OpenworldAUC: Towards Unified Evaluation and Optimization for Open-world Prompt TuningCong Hua, Qianqian Xu, Zhiyong Yang, Zitai Wang et al.ICML 2025
- Context-Aware Answer Extraction in Question AnsweringYeon Seonwoo, Ji-Hoon Kim, Jung-Woo Ha, Alice OhEMNLP 2020 · 32 citations
- Knowledge-Constrained Answer Generation for Open-Ended Video Question AnsweringYao Jin, Guocheng Niu, Xinyan Xiao, Jian Zhang et al.AAAI 2023 · 12 citations
