Lune

EMNLP Findings2023

Reasoning Makes Good Annotators : An Automatic Task-specific Rules Distilling Framework for Low-resource Relation Extraction

Yilin Lu, Juncheng Li, Xiaoqiang Wang, Haochen Shi, Tao Chen, Siliang Tang

Abstract

Relation extraction is often challenged by insufficient labeled data. Previous methods exploit knowledge from unlabeled data by generating pseudo labels in a self-training pipeline, which suffers a gradual drift problem. Logic rules, a transferable and explainable form of expert knowledge, have achieved promising success by improving the model with weak labels. But manually writing comprehensive rules set is challenging and tedious. To alleviate the human labor of writing high-quality rules, in this work, we propose ARIA, an Automatic task-specific Rules dIstilling frAmework. Specifically, we guide the pre-trained language model to reason rules as experts and compose them into robust compound rules for data labeling. Besides, ARIA could continuously enrich the rules set to power the labeling ability by discovering reliable model-labeled data for distinguishable rules generation. Experiments on two public datasets demonstrate the effectiveness of ARIA in a low-resource scenario.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thought cites Self-Consistency Improves Chain of Thought Reasoning in Language Models
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on8

  1. Self-Consistency Improves Chain of Thought Reasoning in Language ModelsXuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V. Le et al.ICLR 2023 · 681 citations
  2. NERO: A Neural Rule Grounding Framework for Label-Efficient Relation ExtractionWenxuan Zhou, Hongtao Lin, Bill Yuchen Lin, Ziqi Wang et al.WWW 2020 · 57 citations
  3. Visually-Prompted Language Model for Fine-Grained Scene Graph Generation in an Open WorldQifan Yu, Juncheng Li, Yu Wu, Siliang Tang et al.ICCV 2023 · 51 citations
  4. Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-ThoughtAbulhair Saparov, He HeICLR 2023 · 38 citations
  5. Prompt-Based Rule Discovery and Boosting for Interactive Weakly-Supervised LearningRongzhi Zhang, Yue Yu, Pranav Shetty, Le Song et al.ACL 2022 · 29 citations

Related papers

  1. Automatic Rule Induction for Efficient Semi-Supervised LearningReid Pryzant, Ziyi Yang, Yichong Xu, Chenguang Zhu et al.EMNLP Findings 2022 · 9 citations
  2. KICE: A Knowledge Consolidation and Expansion Framework for Relation ExtractionYilin Lu, Xiaoqiang Wang, Haofeng Yang, Siliang TangAAAI 2023 · 5 citations
  3. Self-Training using Rules of Grammar for Few-Shot NLUJoonghyuk Hahn, Hyunjoon Cheon, Kyuyeol Han, Cheongjae Lee et al.EMNLP Findings 2021 · 1 citation
  4. Learning from Noisy Crowd Labels with LogicsZhijun Chen, Hailong Sun, Haoqian He, Pengpeng ChenICDE 2023 · 8 citations
  5. End-to-end Learning of Logical Rules for Enhancing Document-level Relation ExtractionKunxun Qi, Jianfeng Du, Hai WanACL 2024
Dusk over the sea between two cliffs drawn in fine vertical lines