ACL Findings2022
Incremental Intent Detection for Medical Domain with Contrast Replay Networks
Guirong Bai, Shizhu He, Kang Liu, Jun Zhao
Abstract
Conventional approaches to medical intent detection require fixed pre-defined intent categories. However, due to the incessant emergence of new medical intents in the real world, such requirement is not practical. Considering that it is computationally expensive to store and re-train the whole data every time new data and intents come in, we propose to incrementally learn emerged intents while avoiding catastrophically forgetting old intents. We first formulate incremental learning for medical intent detection. Then, we employ a memorybased method to handle incremental learning. We further propose to enhance the method with contrastive replay networks, which use multilevel distillation and contrastive objective to address training data imbalance and medical rare words respectively. Experiments show that the proposed method outperforms the state-of-the-art model by 5.7% and 9.1% of accuracy on two benchmarks respectively.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Lineage
Builds on5
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- CBLUE: A Chinese Biomedical Language Understanding Evaluation BenchmarkNingyu Zhang, Mosha Chen, Zhen Bi, Xiaozhuan Liang et al.ACL 2022 · 242 citations
- Continual Relation Learning via Episodic Memory Activation and ReconsolidationXu Han, Yi Dai, Tianyu Gao, Yankai Lin et al.ACL 2020 · 92 citations
- Incremental Event Detection via Knowledge Consolidation NetworksPengfei Cao, Yubo Chen, Jun Zhao, Taifeng WangEMNLP 2020 · 41 citations
- A Gradually Soft Multi-Task and Data-Augmented Approach to Medical Question UnderstandingKhalil Mrini, Franck Dernoncourt, Seunghyun Yoon, Trung Bui et al.ACL 2021
Related papers
- Consistent Representation Learning for Continual Relation ExtractionKang Zhao, Hua Xu, Jiangong Yang, Kai GaoACL Findings 2022 · 45 citations
- One-Shot Replay: Boosting Incremental Object Detection via Retrospecting One ObjectDongbao Yang, Yu Zhou, Xiaopeng Hong, Aoting Zhang et al.AAAI 2023 · 15 citations
- Class Lifelong Learning for Intent Detection via Structure Consolidation NetworksQingbin Liu, Yanchao Hao, Xiaolong Liu, Bo Li et al.ACL Findings 2023 · 3 citations
- Unify Named Entity Recognition Scenarios via Contrastive Real-Time Updating PrototypeYanhe Liu, Peng Wang, Wenjun Ke, Guozheng Li et al.AAAI 2024 · 7 citations
- Prototypical Replay with Old-class Focusing Knowledge Distillation for Incremental Named Entity RecognitionZesheng Liu, Qiannan Zhu, Cuiping Li, Hong ChenAAAI 2025
