Adaptive Memory Retention in Dynamic Graphs
Fabrizio De Castelli, Alessio Gravina, Moshe Eliasof, Carola-Bibiane Schönlieb, Davide Bacciu
Abstract
Modeling graphs demands a careful balance between long-range propagation of information across nodes and the controlled dissipation of noisy or redundant signals to ensure stable learning and generalization. This challenge is exacerbated in dynamic graphs, where structural and temporal information interact, leading to uncontrolled information accumulation and amplifying noise, thereby affecting generalization. We introduce LAMP, a dynamic graph model for snapshotbased dynamic graphs that incorporates adaptive, learned dissipation within a principled dynamical systems framework. Our architecture combines impulsive neural ODEs with an antisymmetric parameterization to model conservative information flow, alongside data-driven dissipative dynamics that regulate information retention over space and time. This formulation yields stable yet expressive representations and enables effective long-range dependency modeling while avoiding pathological information buildup. We provide a theoretical analysis establishing stability guarantees and characterizing the representational power. Extensive experiments on synthetic and real-world benchmarks demonstrate state-of-theart performance, particularly on tasks requiring extended-range dependency modeling.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ff29ddf1-80dc-43ea-85bf-c179db88e035Builds on34
- Strategies for Pre-training Graph Neural NetworksWeihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik et al.ICLR 2020 · 1,744 citations
- Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural NetworksZonghan Wu, Shirui Pan, Guodong Long, Jing Jiang et al.KDD 2020 · 1,738 citations
- Do Transformers Really Perform Badly for Graph Representation?Chengxuan Ying, Tianle Cai, Shengjie Luo, Shuxin Zheng et al.NeurIPS 2021 · 1,632 citations
- Recipe for a General, Powerful, Scalable Graph TransformerLadislav Rampásek, Michael Galkin, Vijay Prakash Dwivedi, Anh Tuan Luu et al.NeurIPS 2022 · 1,216 citations
- Graph Neural Networks Exponentially Lose Expressive Power for Node ClassificationKenta Oono, Taiji SuzukiICLR 2020 · 864 citations
Related papers
- SONAR: Long-Range Graph Propagation Through Information WavesAlessandro Trenta, Alessio Gravina, Davide BacciuNeurIPS 2025 · 5 citations
- Anti-Symmetric DGN: a stable architecture for Deep Graph NetworksAlessio Gravina, Davide Bacciu, Claudio GallicchioICLR 2023 · 14 citations
- Port-Hamiltonian Architectural Bias for Long-Range Propagation in Deep Graph NetworksSimon Heilig, Alessio Gravina, Alessandro Trenta, Claudio Gallicchio et al.ICLR 2025
- On Oversquashing in Graph Neural Networks Through the Lens of Dynamical SystemsAlessio Gravina, Moshe Eliasof, Claudio Gallicchio, Davide Bacciu et al.AAAI 2025 · 22 citations
- Long Range Propagation on Continuous-Time Dynamic GraphsAlessio Gravina, Giulio Lovisotto, Claudio Gallicchio, Davide Bacciu et al.ICML 2024 · 31 citations
