𝓁1 Latent Distance based Continuous-time Graph Representation
Zhao-Rong Lai, Zheng-Sen Zhou, Liangda Fang, Yongsen Zheng, Ziliang Chen
Abstract
Continuous-time graph representation (CTGR) is a widely-used methodology in machine learning, physics, bioinformatics, and social networks. The sequential survival process in a latent space with the squared ℓ 2 distance is an important ultra-low-dimensional embedding for CTGR. However, the squared ℓ 2 distance violates the triangle inequality, which may cause distortion of the relative node positions in the latent space and thus deteriorates in social, contact, and collaboration networks. Reverting to the ℓ 2 distance is infeasible because the corresponding integral computation is intractable. To solve these problems, we propose a theoretically-sound ℓ 1 latent distance based continuous-time graph representation (ℓ 1 LD-CTGR). It facilitates a true latent metric space for the sequential survival process. Moreover, the integral of the hazard function is found to be a closedform piece-wise exponential integral, which well fits the ultra-low-dimensional embedding. To handle the non-differentiable ℓ 1 norm, we successfully find a descent direction of the hazard function to replace the gradient, enabling mainstream learning architectures to learn the parameters. Extensive experiments using both synthetic and real-world data show the competitive performance of ℓ 1 LD-CTGR. * Corresponding author. RELATED WORKS AND UNSOLVED PROBLEMS We introduce the preliminary framework based on (C ¸elikkanat et al., 2024), then raise some problems of the currently-used squared ℓ 2 distance. CONTINUOUS-TIME GRAPH REPRESENTATION Denote G := (V, E) as a graph, where V := 1, 2, • • • , N represents the vertex set, and E := ∪ i,j∈V E ij represents the edge set. Here, E ij := (i, j) ∈ V 2 denotes that nodes i and j are connected by an edge. In the continuous-time interval scenario, the time interval [T ] := [0, T ) must also be considered. Correspondingly, a connection between nodes i and j may last from t k ∈ [T ] to t k+1 ∈ [T ]. Therefore, the edge set should be extended to the following set of tuples An event time e m is defined as the time when an edge gets connected or disconnected, with e 0 = 0 always being an event time. If a node pair undergoes M events e 0 = 0 < e 1 < e 2 < • • • < e M -1 < T , then there are M consecutive intervals [e m , e m+1 ) M -1 m=0 , each with different states. The state
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5f8ca396-b288-4c51-87ea-82673901bc3aBuilds on10
- Towards Better Dynamic Graph Learning: New Architecture and Unified LibraryLe Yu, Leilei Sun, Bowen Du, Weifeng LvNeurIPS 2023 · 323 citations
- Discrete-time Temporal Network Embedding via Implicit Hierarchical Learning in Hyperbolic SpaceMenglin Yang, Min Zhou, Marcus Kalander, Zengfeng Huang et al.KDD 2021 · 101 citations
- Do We Really Need Complicated Model Architectures For Temporal Networks?Weilin Cong, Si Zhang, Jian Kang, Baichuan Yuan et al.ICLR 2023 · 19 citations
- CHIP: A Hawkes Process Model for Continuous-time Networks with Scalable and Consistent EstimationMakan Arastuie, Subhadeep Paul, Kevin S. XuNeurIPS 2020 · 18 citations
- Revisiting K-mer Profile for Effective and Scalable Genome Representation LearningAbdulkadir Çelikkanat, Andrés R. Masegosa, Thomas D. NielsenNeurIPS 2024 · 9 citations
Related papers
- Continuous-Time Graph Representation with Sequential Survival ProcessAbdulkadir Çelikkanat, Nikolaos Nakis, Morten MørupAAAI 2024 · 5 citations
- Disentangle-based Continual Graph Representation LearningXiaoyu Kou, Yankai Lin, Shaobo Liu, Peng Li et al.EMNLP 2020 · 26 citations
- Neural Temporal Walks: Motif-Aware Representation Learning on Continuous-Time Dynamic GraphsMing Jin, Yuan-Fang Li, Shirui PanNeurIPS 2022 · 130 citations
- Direct Embedding of Temporal Network Edges via Time-Decayed Line GraphsSudhanshu Chanpuriya, Ryan A. Rossi, Sungchul Kim, Tong Yu et al.ICLR 2023 · 1 citation
- Riemannian Liquid Spatio-Temporal Graph NetworkLiangsi Lu, Jingchao Wang, Zhaorong Dai, Hanqian Liu et al.WWW 2026 · 1 citation
