Open Relation and Event Type Discovery with Type Abstraction
Sha Li, Heng Ji, Jiawei Han
Abstract
Conventional "closed-world" information extraction (IE) approaches rely on human ontologies to define the scope for extraction. As a result, such approaches fall short when applied to new domains. This calls for systems that can automatically infer new types from given corpora, a task which we refer to as type discovery. To tackle this problem, we introduce the idea of type abstraction, where the model is prompted to generalize and name the type. Then we use the similarity between inferred names to induce clusters. Observing that this abstraction-based representation is often complementary to the entity/trigger token representation, we set up these two representations as two views and design our model as a co-training framework. Our experiments on multiple relation extraction and event extraction datasets consistently show the advantage of our type abstraction approach.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d43a3280-629e-4eed-968d-9deb42152127Cited by top-tier papers9
- Language Models Can Improve Event Prediction by Few-Shot Abductive ReasoningXiaoming Shi, Siqiao Xue, Kangrui Wang, Fan Zhou et al.NeurIPS 2023 · 95 citations
- ClusterLLM: Large Language Models as a Guide for Text ClusteringYuwei Zhang, Zihan Wang, Jingbo ShangEMNLP 2023 · 43 citations
- Grasping the Essentials: Tailoring Large Language Models for Zero-Shot Relation ExtractionSizhe Zhou, Yu Meng, Bowen Jin, Jiawei HanEMNLP 2024 · 6 citations
- Open-world Semi-supervised Generalized Relation Discovery Aligned in a Real-world SettingWilliam Hogan, Jiacheng Li, Jingbo ShangEMNLP 2023 · 6 citations
- Event Ontology Completion with Hierarchical Structure Evolution NetworksPengfei Cao, Yupu Hao, Yubo Chen, Kang Liu et al.EMNLP 2023 · 3 citations
Builds on9
- SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi ChenEMNLP 2021 · 2,496 citations
- Event Extraction by Answering (Almost) Natural QuestionsXinya Du, Claire CardieEMNLP 2020 · 391 citations
- A Joint Neural Model for Information Extraction with Global FeaturesYing Lin, Heng Ji, Fei Huang, Lingfei WuACL 2020 · 376 citations
- Packed Levitated Marker for Entity and Relation ExtractionDeming Ye, Yankai Lin, Peng Li, Maosong SunACL 2022 · 140 citations
- SelfORE: Self-supervised Relational Feature Learning for Open Relation ExtractionXuming Hu, Lijie Wen, Yusong Xu, Chenwei Zhang et al.EMNLP 2020 · 81 citations
Related papers
- Corpus-based Open-Domain Event Type InductionJiaming Shen, Yunyi Zhang, Heng Ji, Jiawei HanEMNLP 2021 · 1 citation
- A Relation-Oriented Clustering Method for Open Relation ExtractionJun Zhao, Tao Gui, Qi Zhang, Yaqian ZhouEMNLP 2021 · 25 citations
- MatchPrompt: Prompt-based Open Relation Extraction with Semantic Consistency Guided ClusteringJiaxin Wang, Lingling Zhang, Jun Liu, Xi Liang et al.EMNLP 2022 · 4 citations
- Abstractive Open Information ExtractionKevin Pei, Ishan Jindal, Kevin Chen-Chuan ChangEMNLP 2023
- Lifelong Event Detection with Knowledge TransferPengfei Yu, Heng Ji, Prem NatarajanEMNLP 2021
