Lune

EMNLP Findings2023

Efficient Data Learning for Open Information Extraction with Pre-trained Language Models

Zhiyuan Fan, Shizhu He

Abstract

Open Information Extraction (OpenIE) is a fundamental yet challenging task in Natural Language Processing, which involves extracting all triples (subject, predicate, object) from a given sentence. While labeling-based methods have their merits, generation-based techniques offer unique advantages, such as the ability to generate tokens not present in the original sentence. However, these generation-based methods often require a significant amount of training data to learn the task form of OpenIE and substantial training time to overcome slow model convergence due to the order penalty. In this paper, we introduce a novel framework, OK-IE, that ingeniously transforms the task form of Ope-nIE into the pre-training task form of the T5 model, thereby reducing the need for extensive training data. Furthermore, we introduce an innovative concept of Anchor to control the sequence of model outputs, effectively eliminating the impact of order penalty on model convergence and significantly reducing training time. Experimental results indicate that, compared to previous SOTA methods, OK-IE requires only 1/100 of the training data (900 instances) and 1/120 of the training time (3 minutes) to achieve comparable results.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Alignment-Augmented Consistent Translation for Multilingual Open Information Extraction cites IMoJIE: Iterative Memory-Based Joint Open Information Extraction
  • Alignment-Augmented Consistent Translation for Multilingual Open Information Extraction cites OpenIE6: Iterative Grid Labeling and Coordination Analysis for Open Information Extraction
  • MILIE: Modular & Iterative Multilingual Open Information Extraction cites IMoJIE: Iterative Memory-Based Joint Open Information Extraction
  • MILIE: Modular & Iterative Multilingual Open Information Extraction cites OpenIE6: Iterative Grid Labeling and Coordination Analysis for Open Information Extraction
  • OpenIE6: Iterative Grid Labeling and Coordination Analysis for Open Information Extraction cites IMoJIE: Iterative Memory-Based Joint Open Information Extraction
  • DetIE: Multilingual Open Information Extraction Inspired by Object Detection cites IMoJIE: Iterative Memory-Based Joint Open Information Extraction
  • DetIE: Multilingual Open Information Extraction Inspired by Object Detection cites OpenIE6: Iterative Grid Labeling and Coordination Analysis for Open Information Extraction
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. Revisiting Classical Chinese Event Extraction with Ancient Literature InformationXiaoyi Bao, Zhongqing Wang, Jinghang Gu, Chu-Ren HuangACL 2025

Builds on5

  1. DetIE: Multilingual Open Information Extraction Inspired by Object DetectionMichael Vasilkovsky, Anton Alekseev, Valentin Malykh, Ilya Shenbin et al.AAAI 2022 · 24 citations
  2. OpenIE6: Iterative Grid Labeling and Coordination Analysis for Open Information ExtractionKeshav Kolluru, Vaibhav Adlakha, Samarth Aggarwal, Mausam et al.EMNLP 2020 · 13 citations
  3. IMoJIE: Iterative Memory-Based Joint Open Information ExtractionKeshav Kolluru, Samarth Aggarwal, Vipul Rathore, Mausam et al.ACL 2020 · 5 citations
  4. Alignment-Augmented Consistent Translation for Multilingual Open Information ExtractionKeshav Kolluru, Muqeeth Mohammed, Shubham Mittal, Soumen Chakrabarti et al.ACL 2022
  5. MILIE: Modular & Iterative Multilingual Open Information ExtractionBhushan Kotnis, Kiril Gashteovski, Daniel Oñoro-Rubio, Ammar Shaker et al.ACL 2022

Related papers

  1. Maximal Clique Based Non-Autoregressive Open Information ExtractionBowen Yu, Yucheng Wang, Tingwen Liu, Hongsong Zhu et al.EMNLP 2021 · 14 citations
  2. Syntactically Rich Discriminative Training: An Effective Method for Open Information ExtractionFrank Mtumbuka, Thomas LukasiewiczEMNLP 2022 · 1 citation
  3. OIE@OIA: an Adaptable and Efficient Open Information Extraction FrameworkXin Wang, Minlong Peng, Mingming Sun, Ping LiACL 2022 · 9 citations
  4. A Predicate-Function-Argument Annotation of Natural Language for Open-Domain Information eXpressionMingming Sun, Wenyue Hua, Zoey Liu, Xin Wang et al.EMNLP 2020 · 13 citations
  5. Systematic Comparison of Neural Architectures and Training Approaches for Open Information ExtractionPatrick Hohenecker, Frank Mtumbuka, Vid Kocijan, Thomas LukasiewiczEMNLP 2020 · 10 citations
Dusk over the sea between two cliffs drawn in fine vertical lines