An Autoregressive Text-to-Graph Framework for Joint Entity and Relation Extraction
Urchade Zaratiana, Nadi Tomeh, Pierre Holat, Thierry Charnois
Abstract
In this paper, we propose a novel method for joint entity and relation extraction from unstructured text by framing it as a conditional sequence generation problem. In contrast to conventional generative information extraction models that are left-to-right token-level generators, our approach is span-based. It generates a linearized graph where nodes represent text spans and edges represent relation triplets. Our method employs a transformer encoder-decoder architecture with pointing mechanism on a dynamic vocabulary of spans and relation types. Our model can capture the structural characteristics and boundaries of entities and relations through span representations while simultaneously grounding the generated output in the original text thanks to the pointing mechanism. Evaluation on benchmark datasets validates the effectiveness of our approach, demonstrating competitive results. Code is available at https://github.com/urchade/ATG.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ec9559dc-1960-413d-9c8c-d7176f50cb62Cited by top-tier papers1
Ask how each one uses itBuilds on20
- The Curious Case of Neural Text DegenerationAri Holtzman, Jan Buys, Li Du, Maxwell Forbes et al.ICLR 2020 · 4,112 citations
- Diffusion-LM Improves Controllable Text GenerationXiang Lisa Li, John Thickstun, Ishaan Gulrajani, Percy Liang et al.NeurIPS 2022 · 1,546 citations
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
- Pix2seq: A Language Modeling Framework for Object DetectionTing Chen, Saurabh Saxena, Lala Li, David J. Fleet et al.ICLR 2022 · 435 citations
- DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding SharingPengcheng He, Jianfeng Gao, Weizhu ChenICLR 2023 · 394 citations
Related papers
- Effective Modeling of Encoder-Decoder Architecture for Joint Entity and Relation ExtractionTapas Nayak, Hwee Tou NgAAAI 2020 · 272 citations
- UniRel: Unified Representation and Interaction for Joint Relational Triple ExtractionWei Tang, Benfeng Xu, Yuyue Zhao, Zhendong Mao et al.EMNLP 2022 · 59 citations
- PRGC: Potential Relation and Global Correspondence Based Joint Relational Triple ExtractionHengyi Zheng, Rui Wen, Xi Chen, Yifan Yang et al.ACL 2021
- UTC-IE: A Unified Token-pair Classification Architecture for Information ExtractionHang Yan, Yu Sun, Xiaonan Li, Yunhua Zhou et al.ACL 2023 · 8 citations
- GDPNet: Refining Latent Multi-View Graph for Relation ExtractionFuzhao Xue, Aixin Sun, Hao Zhang, Eng Siong ChngAAAI 2021 · 90 citations
