STEAM: Self-Supervised Taxonomy Expansion with Mini-Paths
Yue Yu, Yinghao Li, Jiaming Shen, Hao Feng, Jimeng Sun, Chao Zhang
Abstract
Taxonomies are important knowledge ontologies that underpin numerous applications on a daily basis, but many taxonomies used in practice suffer from the low coverage issue. We study the taxonomy expansion problem, which aims to expand existing taxonomies with new concept terms. We propose a self-supervised taxonomy expansion model named STEAM, which leverages natural supervision in the existing taxonomy for expansion. To generate natural self-supervision signals, STEAM samples mini-paths from the existing taxonomy, and formulates a node attachment prediction task between anchor mini-paths and query terms. To solve the node attachment task, it learns feature representations for query-anchor pairs from multiple views and performs multi-view co-training for prediction. Extensive experiments show that STEAM outperforms state-of-the-art methods for taxonomy expansion by 11.6% in accuracy and 7.0% in mean reciprocal rank on three public benchmarks. The implementation of STEAM can be found at https://github.com/yueyu1030/STEAM . CCS CONCEPTS • Computing methodologies → Information extraction.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4fdd0ee3-efa7-4761-a352-8b30b86ca7b2Cited by top-tier papers20
- SeqMix: Augmenting Active Sequence Labeling via Sequence MixupRongzhi Zhang, Yue Yu, Chao ZhangEMNLP 2020 · 65 citations
- Taxonomy Completion via Triplet Matching NetworkJieyu Zhang, Xiangchen Song, Ying Zeng, Jiaze Chen et al.AAAI 2021 · 48 citations
- TaxoCom: Topic Taxonomy Completion with Hierarchical Discovery of Novel Topic ClustersDongha Lee, Jiaming Shen, Seongku Kang, Susik Yoon et al.WWW 2022 · 46 citations
- TaxoEnrich: Self-Supervised Taxonomy Completion via Structure-Semantic RepresentationsMinhao Jiang, Xiangchen Song, Jieyu Zhang, Jiawei HanWWW 2022 · 45 citations
- Enhancing Taxonomy Completion with Concept Generation via Fusing Relational RepresentationsQingkai Zeng, Jinfeng Lin, Wenhao Yu, Jane Cleland-Huang et al.KDD 2021 · 37 citations
Builds on7
- SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized OptimizationHaoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu et al.ACL 2020 · 148 citations
- BOND: BERT-Assisted Open-Domain Named Entity Recognition with Distant SupervisionChen Liang, Yue Yu, Haoming Jiang, Siawpeng Er et al.KDD 2020 · 118 citations
- TaxoExpan: Self-supervised Taxonomy Expansion with Position-Enhanced Graph Neural NetworkJiaming Shen, Zhihong Shen, Chenyan Xiong, Chi Wang et al.WWW 2020 · 85 citations
- Expanding Taxonomies with Implicit Edge SemanticsEmaad A. Manzoor, Rui Li, Dhananjay Shrouty, Jure LeskovecWWW 2020 · 49 citations
- Taxonomy Construction of Unseen Domains via Graph-based Cross-Domain Knowledge TransferChao Shang, Sarthak Dash, Md. Faisal Mahbub Chowdhury, Nandana Mihindukulasooriya et al.ACL 2020 · 27 citations
Related papers
- TEMP: Taxonomy Expansion with Dynamic Margin Loss through Taxonomy-PathsZichen Liu, Hongyuan Xu, Yanlong Wen, Ning Jiang et al.EMNLP 2021 · 16 citations
- TaxoComplete: Self-Supervised Taxonomy Completion Leveraging Position-Enhanced Semantic MatchingInes Arous, Ljiljana Dolamic, Philippe Cudré-MaurouxWWW 2023 · 16 citations
- TacoPrompt: A Collaborative Multi-Task Prompt Learning Method for Self-Supervised Taxonomy CompletionHongyuan Xu, Ciyi Liu, Yuhang Niu, Yunong Chen et al.EMNLP 2023 · 9 citations
- Enquire One's Parent and Child Before Decision: Fully Exploit Hierarchical Structure for Self-Supervised Taxonomy ExpansionSuyuchen Wang, Ruihui Zhao, Xi Chen, Yefeng Zheng et al.WWW 2021 · 33 citations
- DNG: Taxonomy Expansion by Exploring the Intrinsic Directed Structure on Non-gaussian SpaceSonglin Zhai, Weiqing Wang, Yuan-Fang Li, Yuan MengAAAI 2023 · 6 citations
