Dynamic Neural Relational Inference
Colin Graber, Alexander G. Schwing
Abstract
Understanding interactions between entities, e.g., joints of the human body, team sports players, etc., is crucial for tasks like forecasting. However, interactions between entities are commonly not observed and often hard to quantify. To address this challenge, recently, 'Neural Relational Inference' was introduced. It predicts static relations between entities in a system and provides an interpretable representation of the underlying system dynamics that are used for better trajectory forecasting. However, generally, relations between entities change as time progresses. Hence, static relations improperly model the data. In response to this, we develop Dynamic Neural Relational Inference (dNRI), which incorporates insights from sequential latent variable models to predict separate relation graphs for every timestep. We demonstrate on several real-world datasets that modeling dynamic relations improves forecasting of complex trajectories.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers23
- GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational ReasoningChenxin Xu, Maosen Li, Zhenyang Ni, Ya Zhang et al.CVPR 2022 · 171 citations
- Remember Intentions: Retrospective-Memory-based Trajectory PredictionChenxin Xu, Weibo Mao, Wenjun Zhang, Siheng ChenCVPR 2022 · 140 citations
- RAIN: Reinforced Hybrid Attention Inference Network for Motion ForecastingJiachen Li, Fan Yang, Hengbo Ma, Srikanth Malla et al.ICCV 2021 · 49 citations
- Roto-translated Local Coordinate Frames For Interacting Dynamical SystemsMiltiadis Kofinas, Naveen Shankar Nagaraja, Efstratios GavvesNeurIPS 2021 · 40 citations
- Social Fabric: Tubelet Compositions for Video Relation DetectionShuo Chen, Zenglin Shi, Pascal Mettes, Cees G. M. SnoekICCV 2021 · 25 citations
Builds on3
- The Trajectron: Probabilistic Multi-Agent Trajectory Modeling With Dynamic Spatiotemporal GraphsBoris Ivanovic, Marco PavoneICCV 2019 · 473 citations
- Compositional Video PredictionYufei Ye, Maneesh Singh, Abhinav Gupta, Shubham TulsianiICCV 2019 · 84 citations
- Sequential Latent Spaces for Modeling the Intention During Diverse Image CaptioningJyoti Aneja, Harsh Agrawal, Dhruv Batra, Alexander G. SchwingICCV 2019 · 71 citations
Related papers
- Memory-augmented Dynamic Neural Relational InferenceDong Gong, Zhen Zhang, Qinfeng (Javen) Shi, Anton van den HengelICCV 2021 · 19 citations
- Neural Relational Inference with Efficient Message Passing MechanismsSiyuan Chen, Jiahai Wang, Guoqing LiAAAI 2021 · 25 citations
- Neural Relational Inference with Node-Specific InformationErshad BanijamaliICLR 2022 · 7 citations
- EvolveGraph: Multi-Agent Trajectory Prediction with Dynamic Relational ReasoningJiachen Li, Fan Yang, Masayoshi Tomizuka, Chiho ChoiNeurIPS 2020 · 258 citations
- Learning Heterogeneous Interaction Strengths by Trajectory Prediction with Graph Neural NetworkSeungwoong Ha, Hawoong JeongICLR 2023 · 2 citations
