Lune

ACL Findings2022

Open Relation Modeling: Learning to Define Relations between Entities

Jie Huang, Kevin Chang, Jinjun Xiong, Wen-Mei Hwu

Abstract

Relations between entities can be represented by different instances, e.g., a sentence containing both entities or a fact in a Knowledge Graph (KG). However, these instances may not well capture the general relations between entities, may be difficult to understand by humans, even may not be found due to the incompleteness of the knowledge source. In this paper, we introduce the Open Relation Modeling problemgiven two entities, generate a coherent sentence describing the relation between them. To solve this problem, we propose to teach machines to generate definition-like relation descriptions by letting them learn from defining entities. Specifically, we fine-tune Pre-trained Language Models (PLMs) to produce definitions conditioned on extracted entity pairs. To help PLMs reason between entities and provide additional relational knowledge to PLMs for open relation modeling, we incorporate reasoning paths in KGs and include a reasoning path selection mechanism. Experimental results show that our model can generate concise but informative relation descriptions that capture the representative characteristics of entities. 1

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 4 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers4

  1. FLASK: Fine-grained Language Model Evaluation based on Alignment Skill SetsSeonghyeon Ye, Doyoung Kim, Sungdong Kim, Hyeonbin Hwang et al.ICLR 2024 · 176 citations
  2. Understanding Jargon: Combining Extraction and Generation for Definition ModelingJie Huang, Hanyin Shao, Kevin Chen-Chuan Chang, Jinjun Xiong et al.EMNLP 2022 · 11 citations
  3. DEER: Descriptive Knowledge Graph for Explaining Entity RelationshipsJie Huang, Kerui Zhu, Kevin Chen-Chuan Chang, Jinjun Xiong et al.EMNLP 2022 · 8 citations
  4. DimonGen: Diversified Generative Commonsense Reasoning for Explaining Concept RelationshipsChenzhengyi Liu, Jie Huang, Kerui Zhu, Kevin Chen-Chuan ChangACL 2023 · 6 citations

Builds on6

  1. Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
  2. BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
  3. CommonGen: A Constrained Text Generation Challenge for Generative Commonsense ReasoningBill Yuchen Lin, Wangchunshu Zhou, Ming Shen, Pei Zhou et al.EMNLP Findings 2020 · 239 citations
  4. Evaluating Commonsense in Pre-Trained Language ModelsXuhui Zhou, Yue Zhang, Leyang Cui, Dandan HuangAAAI 2020 · 198 citations
  5. Generationary or "How We Went beyond Word Sense Inventories and Learned to Gloss"Michele Bevilacqua, Marco Maru, Roberto NavigliEMNLP 2020 · 41 citations

Related papers

  1. Distilling Relation Embeddings from Pretrained Language ModelsAsahi Ushio, José Camacho-Collados, Steven SchockaertEMNLP 2021 · 13 citations
  2. Inducing Relational Knowledge from BERTZied Bouraoui, José Camacho-Collados, Steven SchockaertAAAI 2020 · 183 citations
  3. Solving Hard Analogy Questions with Relation Embedding ChainsNitesh Kumar, Steven SchockaertEMNLP 2023
  4. BertNet: Harvesting Knowledge Graphs with Arbitrary Relations from Pretrained Language ModelsShibo Hao, Bowen Tan, Kaiwen Tang, Bin Ni et al.ACL Findings 2023 · 44 citations
  5. VER: Unifying Verbalizing Entities and RelationsJie Huang, Kevin ChangEMNLP Findings 2023 · 2 citations
Dusk over the sea between two cliffs drawn in fine vertical lines