Networked Time Series Imputation via Position-aware Graph Enhanced Variational Autoencoders
Dingsu Wang, Yuchen Yan, Ruizhong Qiu, Yada Zhu, Kaiyu Guan, Andrew Margenot, Hanghang Tong
Abstract
Multivariate time series (MTS) imputation is a widely studied problem in recent years. Existing methods can be divided into two main groups, including (1) deep recurrent or generative models that primarily focus on time series features, and (2) graph neural networks (GNNs) based models that utilize the topological information from the inherent graph structure of MTS as relational inductive bias for imputation. Nevertheless, these methods either neglect topological information or assume the graph structure is fixed and accurately known. Thus, they fail to fully utilize the graph dynamics for precise imputation in more challenging MTS data such as networked time series (NTS), where the underlying graph is constantly changing and might have missing edges. In this paper, we propose a novel approach to overcome these limitations. First, we define the problem of imputation over NTS which contains missing values in both node time series features and graph structures. Then, we design a new model named PoGeVon which leverages variational autoencoder (VAE) to predict missing values over both node time series features and graph structures. In particular, we propose a new node position embedding based on random walk with restart (RWR) in the encoder with provable higher expressive power compared with message-passing based graph neural networks (GNNs). We further design a decoder with 3-stage predictions from the perspective of multi-task learning to impute missing values in both time series and graph structures reciprocally. Experiment results demonstrate the effectiveness of our model over baselines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 05ddd892-2aec-4677-885f-3de0ca3efcdcCited by top-tier papers23
- Discrete-state Continuous-time Diffusion for Graph GenerationZhe Xu, Ruizhong Qiu, Yuzhong Chen, Huiyuan Chen et al.NeurIPS 2024 · 92 citations
- From Trainable Negative Depth to Edge Heterophily in GraphsYuchen Yan, Yuzhong Chen, Huiyuan Chen, Minghua Xu et al.NeurIPS 2023 · 41 citations
- Reconciling Competing Sampling Strategies of Network EmbeddingYuchen Yan, Baoyu Jing, Lihui Liu, Ruijie Wang et al.NeurIPS 2023 · 34 citations
- PaCEr: Network Embedding From Positional to StructuralYuchen Yan, Yongyi Hu, Qinghai Zhou, Lihui Liu et al.WWW 2024 · 33 citations
- Graph Mixup on Approximate Gromov-Wasserstein GeodesicsZhichen Zeng, Ruizhong Qiu, Zhe Xu, Zhining Liu et al.ICML 2024 · 30 citations
Builds on24
- Reformer: The Efficient TransformerNikita Kitaev, Lukasz Kaiser, Anselm LevskayaICLR 2020 · 2,878 citations
- Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural NetworksZonghan Wu, Shirui Pan, Guodong Long, Jing Jiang et al.KDD 2020 · 1,738 citations
- Inductive representation learning on temporal graphsDa Xu, Chuanwei Ruan, Evren Körpeoglu, Sushant Kumar et al.ICLR 2020 · 901 citations
- Graph Representation Learning via Graphical Mutual Information MaximizationZhen Peng, Wenbing Huang, Minnan Luo, Qinghua Zheng et al.WWW 2020 · 682 citations
- Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple MethodsDerek Lim, Felix Hohne, Xiuyu Li, Sijia Linda Huang et al.NeurIPS 2021 · 534 citations
Related papers
- Filling the G_ap_s: Multivariate Time Series Imputation by Graph Neural NetworksAndrea Cini, Ivan Marisca, Cesare AlippiICLR 2022 · 179 citations
- Motif-aware Graph Neural Networks for Networked Time Series ImputationNourhan Ahmed, Vijaya Krishna Yalavarthi, Lars Schmidt-ThiemeAAAI 2025 · 2 citations
- Uncovering the Missing Pattern: Unified Framework Towards Trajectory Imputation and PredictionYi Xu, Armin Bazarjani, Hyung-Gun Chi, Chiho Choi et al.CVPR 2023
- Learning to Reconstruct Missing Data from Spatiotemporal Graphs with Sparse ObservationsIvan Marisca, Andrea Cini, Cesare AlippiNeurIPS 2022 · 154 citations
- Mining of Switching Sparse Networks for Missing Value Imputation in Multivariate Time SeriesKohei Obata, Koki Kawabata, Yasuko Matsubara, Yasushi SakuraiKDD 2024 · 6 citations
