Delay-DSGN: A Dynamic Spiking Graph Neural Network with Delay Mechanisms for Evolving Graph
Zhiqiang Wang, Jianghao Wen, Jianqing Liang
Abstract
Dynamic graph representation learning using Spiking Neural Networks (SNNs) exploits the temporal spiking behavior of neurons, offering advantages in capturing the temporal evolution and sparsity of dynamic graphs. However, existing SNN-based methods often fail to effectively capture the impact of latency in information propagation on node representations. To address this, we propose Delay-DSGN, a dynamic spiking graph neural network incorporating a learnable delay mechanism. By leveraging synaptic plasticity, the model dynamically adjusts connection weights and propagation speeds, enhancing temporal correlations and enabling historical data to influence future representations. Specifically, we introduce a Gaussian delay kernel into the neighborhood aggregation process at each time step, adaptively delaying historical information to future time steps and mitigating information forgetting. Experiments on three large-scale dynamic graph datasets demonstrate that Delay-DSGN outperforms eight state-of-the-art methods, achieving the best results in node classification tasks. We also theoretically derive the constraint conditions between the Gaussian kernel's standard deviation and size, ensuring stable training and preventing gradient explosion and vanishing issues.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 703af6db-4ff3-4d78-9a51-ac07a0f0432bBuilds on12
- EvolveGCN: Evolving Graph Convolutional Networks for Dynamic GraphsAldo Pareja, Giacomo Domeniconi, Jie Chen, Tengfei Ma et al.AAAI 2020 · 1,429 citations
- Inductive representation learning on temporal graphsDa Xu, Chuanwei Ruan, Evren Körpeoglu, Sushant Kumar et al.ICLR 2020 · 901 citations
- Inductive Representation Learning in Temporal Networks via Causal Anonymous WalksYanbang Wang, Yen-Yu Chang, Yunyu Liu, Jure Leskovec et al.ICLR 2021 · 326 citations
- Implicit Graph Neural NetworksFangda Gu, Heng Chang, Wenwu Zhu, Somayeh Sojoudi et al.NeurIPS 2020 · 188 citations
- Neural Temporal Walks: Motif-Aware Representation Learning on Continuous-Time Dynamic GraphsMing Jin, Yuan-Fang Li, Shirui PanNeurIPS 2022 · 130 citations
Related papers
- Dynamic Spiking Graph Neural NetworksNan Yin, Mengzhu Wang, Zhenghan Chen, Giulia De Masi et al.AAAI 2024 · 2 citations
- Dynamic Reactive Spiking Graph Neural NetworkHan Zhao, Xu Yang, Cheng Deng, Junchi YanAAAI 2024 · 14 citations
- Scaling Up Dynamic Graph Representation Learning via Spiking Neural NetworksJintang Li, Zhouxin Yu, Zulun Zhu, Liang Chen et al.AAAI 2023 · 51 citations
- E2SGNN: Reconciling Expression and Efficiency in Spiking Graph Neural NetworkHan Zhao, Xu Yang, Cheng Deng, Fan LiuWWW 2026
- Learning Delays in Spiking Neural Networks using Dilated Convolutions with Learnable SpacingsIlyass Hammouamri, Ismail Khalfaoui Hassani, Timothée MasquelierICLR 2024 · 105 citations
