DICE: Data-Efficient Clinical Event Extraction with Generative Models
Mingyu Derek Ma, Alexander Taylor, Wei Wang, Nanyun Peng
Abstract
Event extraction for the clinical domain is an under-explored research area. The lack of training data along with the high volume of domainspecific terminologies with vague entity boundaries makes the task especially challenging. In this paper, we introduce DICE, a robust and data-efficient generative model for clinical event extraction. DICE frames event extraction as a conditional generation problem and introduces a contrastive learning objective to accurately decide the boundaries of biomedical mentions. DICE also trains an auxiliary mention identification task jointly with event extraction tasks to better identify entity mention boundaries, and further introduces special markers to incorporate identified entity mentions as trigger and argument candidates for their respective tasks. To benchmark clinical event extraction, we compose MACCROBAT-EE, the first clinical event extraction dataset with argument annotation, based on an existing clinical information extraction dataset, MACCROBAT (Caufield et al., 2019). Our experiments demonstrate state-of-the-art performances of DICE for clinical and news domain event extraction, especially under low data settings. * Equal contribution. A 45 -year -old lady sought dermatology consultation for severely tender erythematous vesicles and bullae over back , chest and arms .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3583e5dc-805c-4fff-8113-1213f77a5661Cited by top-tier papers9
- STAR: Boosting Low-Resource Information Extraction by Structure-to-Text Data Generation with Large Language ModelsMingyu Derek Ma, Xiaoxuan Wang, Po-Nien Kung, P. Jeffrey Brantingham et al.AAAI 2024 · 22 citations
- Can NLI Provide Proper Indirect Supervision for Low-resource Biomedical Relation Extraction?Jiashu Xu, Mingyu Derek Ma, Muhao ChenACL 2023 · 14 citations
- Memorize and Rank: Elevating Large Language Models for Clinical Diagnosis PredictionMingyu Derek Ma, Xiaoxuan Wang, Yijia Xiao, Anthony Cuturrufo et al.AAAI 2025 · 7 citations
- Explicit, Implicit, and Scattered: Revisiting Event Extraction to Capture Complex ArgumentsOmar Sharif, Joseph Gatto, Madhusudan Basak, Sarah Masud PreumEMNLP 2024 · 4 citations
- Improving Event Definition Following For Zero-Shot Event DetectionZefan Cai, Po-Nien Kung, Ashima Suvarna, Mingyu Derek Ma et al.ACL 2024 · 3 citations
Builds on14
- Event Extraction by Answering (Almost) Natural QuestionsXinya Du, Claire CardieEMNLP 2020 · 391 citations
- A Joint Neural Model for Information Extraction with Global FeaturesYing Lin, Heng Ji, Fei Huang, Lingfei WuACL 2020 · 376 citations
- COCO-LM: Correcting and Contrasting Text Sequences for Language Model PretrainingYu Meng, Chenyan Xiong, Payal Bajaj, Saurabh Tiwary et al.NeurIPS 2021 · 231 citations
- Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection NetworkYutai Hou, Wanxiang Che, Yongkui Lai, Zhihan Zhou et al.ACL 2020 · 186 citations
- Prompt for Extraction? PAIE: Prompting Argument Interaction for Event Argument ExtractionYubo Ma, Zehao Wang, Yixin Cao, Mukai Li et al.ACL 2022 · 182 citations
Related papers
- MEE: A Novel Multilingual Event Extraction DatasetAmir Pouran Ben Veyseh, Javid Ebrahimi, Franck Dernoncourt, Thien Huu NguyenEMNLP 2022 · 3 citations
- Revisiting Event Argument Extraction: Can EAE Models Learn Better When Being Aware of Event Co-occurrences?Yuxin He, Jingyue Hu, Buzhou TangACL 2023 · 26 citations
- MailEx: Email Event and Argument ExtractionSaurabh Srivastava, Gaurav Singh, Shou Matsumoto, Ali K. Raz et al.EMNLP 2023 · 3 citations
- SciEvent: Benchmarking Multi-domain Scientific Event ExtractionBofu Dong, Pritesh Shah, Sumedh Sonawane, Tiyasha Banerjee et al.EMNLP 2025
- Dynamic Prefix-Tuning for Generative Template-based Event ExtractionXiao Liu, Heyan Huang, Ge Shi, Bo WangACL 2022 · 120 citations
