Understanding Procedural Text using Interactive Entity Networks
Jizhi Tang, Yansong Feng, Dongyan Zhao
Abstract
The task of procedural text comprehension aims to understand the dynamic nature of entities/objects in a process. Here, the key is to track how the entities interact with each other and how their states are changing along the procedure. Recent efforts have made great progress to track multiple entities in a procedural text, but usually treat each entity separately and ignore the fact that there are often multiple entities interacting with each other during one process, some of which are even explicitly mentioned. In this paper, we propose a novel Interactive Entity Network (IEN), which is a recurrent network with memory equipped cells for state tracking. In each IEN cell, we maintain different attention matrices through specific memories to model different types of entity interactions. Importantly, we can update these memories in a sequential manner so as to explore the causal relationship between entity actions and subsequent state changes. We evaluate our model on a benchmark dataset, and the results show that IEN outperforms stateof-the-art models by precisely capturing the interactions of multiple entities and explicitly leverage the relationship between entity interactions and subsequent state changes. Our code is available at: https://github.com/ esddse/IEN .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 100b588b-2178-4c6a-b9d1-7f6c50a4e5f0Cited by top-tier papers2
- Knowledge-Aware Procedural Text Understanding with Multi-Stage TrainingZhihan Zhang, Xiubo Geng, Tao Qin, Yunfang Wu et al.WWW 2021 · 23 citations
- Procedural Text Understanding via Scene-Wise EvolutionJialong Tang, Hongyu Lin, Meng Liao, Yaojie Lu et al.AAAI 2022 · 2 citations
Related papers
- Reasoning over Entity-Action-Location Graph for Procedural Text UnderstandingHao Huang, Xiubo Geng, Jian Pei, Guodong Long et al.ACL 2021
- Modeling Temporal-Modal Entity Graph for Procedural Multimodal Machine ComprehensionHuibin Zhang, Zhengkun Zhang, Yao Zhang, Jun Wang et al.ACL 2022 · 5 citations
- Recurrent Interaction Network for Jointly Extracting Entities and Classifying RelationsKai Sun, Richong Zhang, Samuel Mensah, Yongyi Mao et al.EMNLP 2020 · 34 citations
- Recurrent Event Network: Autoregressive Structure Inferenceover Temporal Knowledge GraphsWoojeong Jin, Meng Qu, Xisen Jin, Xiang RenEMNLP 2020 · 353 citations
- ReMeREC: Relation-aware and Multi-entity Referring Expression ComprehensionYizhi Hu, Zezhao Tian, Xingqun Qi, Chen Su et al.ACM MM 2025
