Graph Adaptive Autoregressive Moving Average Models
Moshe Eliasof, Alessio Gravina, Andrea Ceni, Claudio Gallicchio, Davide Bacciu, Carola-Bibiane Schönlieb
摘要
Graph State Space Models (SSMs) have recently been introduced to enhance Graph Neural Networks (GNNs) in modeling long-range interactions. Despite their success, existing methods either compromise on permutation equivariance or limit their focus to pairwise interactions rather than sequences. Building on the connection between Autoregressive Moving Average (ARMA) and SSM, in this paper, we introduce GRAMA, a Graph Adaptive method based on a learnable ARMA framework that addresses these limitations. By transforming from static to sequential graph data, GRAMA leverages the strengths of the ARMA framework, while preserving permutation equivariance. Moreover, GRAMA incorporates a selective attention mechanism for dynamic learning of ARMA coefficients, enabling efficient and flexible long-range information propagation. We also establish theoretical connections between GRAMA and Selective SSMs, providing insights into its ability to capture long-range dependencies. Experiments on 26 synthetic and real-world datasets demonstrate that GRAMA consistently outperforms backbone models and performs competitively with state-of-the-art methods.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper3
- Improving Long-Range Interactions in Graph Neural Simulators via Hamiltonian DynamicsTai Hoang, Alessandro Trenta, Alessio Gravina, Niklas Freymuth 等ICLR 2026 · 被引用 6 次
- Learning from Historical Activations in Graph Neural NetworksYaniv Galron, Hadar Sinai, Haggai Maron, Moshe EliasofICLR 2026
- Adaptive Memory Retention in Dynamic GraphsFabrizio De Castelli, Alessio Gravina, Moshe Eliasof, Carola-Bibiane Schönlieb 等ICML 2026
它引用的顶会 Paper54
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong 等NeurIPS 2020 · 被引用 3,935 次
- Efficiently Modeling Long Sequences with Structured State SpacesAlbert Gu, Karan Goel, Christopher RéICLR 2022 · 被引用 3,482 次
- Big Bird: Transformers for Longer SequencesManzil Zaheer, Guru Guruganesh, Kumar Avinava Dubey, Joshua Ainslie 等NeurIPS 2020 · 被引用 3,159 次
- Simple and Deep Graph Convolutional NetworksMing Chen, Zhewei Wei, Zengfeng Huang, Bolin Ding 等ICML 2020 · 被引用 1,910 次
- Beyond Homophily in Graph Neural Networks: Current Limitations and Effective DesignsJiong Zhu, Yujun Yan, Lingxiao Zhao, Mark Heimann 等NeurIPS 2020 · 被引用 1,490 次
相关 Paper
- Graph Mamba: Towards Learning on Graphs with State Space ModelsAli Behrouz, Farnoosh HashemiKDD 2024 · 被引用 63 次
- Representing Long-Range Context for Graph Neural Networks with Global AttentionZhanghao Wu, Paras Jain, Matthew A. Wright, Azalia Mirhoseini 等NeurIPS 2021 · 被引用 450 次
- Memory Augmented Graph Neural Networks for Sequential RecommendationChen Ma, Liheng Ma, Yingxue Zhang, Jianing Sun 等AAAI 2020 · 被引用 239 次
- State Space Models on Temporal Graphs: A First-Principles StudyJintang Li, Ruofan Wu, Xinzhou Jin, Boqun Ma 等NeurIPS 2024 · 被引用 29 次
- Long Short-Term Graph Memory Against Class-imbalanced Over-smoothingLiang Yang, Jiayi Wang, Tingting Zhang, Dongxiao He 等ACM MM 2023 · 被引用 4 次
