Simultaneous Missing Value Imputation and Structure Learning with Groups
Pablo Morales-Alvarez, Wenbo Gong, Angus Lamb, Simon Woodhead, Simon Peyton Jones, Nick Pawlowski, Miltiadis Allamanis, Cheng Zhang
Abstract
Learning structures between groups of variables from data with missing values is an important task in the real world, yet difficult to solve. One typical scenario is discovering the structure among topics in the education domain to identify learning pathways. Here, the observations are student performances for questions under each topic which contain missing values. However, most existing methods focus on learning structures between a few individual variables from the complete data. In this work, we propose VISL, a novel scalable structure learning approach that can simultaneously infer structures between groups of variables under missing data and perform missing value imputations with deep learning. Particularly, we propose a generative model with a structured latent space and a graph neural network-based architecture, scaling to a large number of variables. Empirically, we conduct extensive experiments on synthetic, semi-synthetic, and real-world education data sets. We show improved performances on both imputation and structure learning accuracy compared to popular and recent approaches.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers6
- Transformed Distribution Matching for Missing Value ImputationHe Zhao, Ke Sun, Amir Dezfouli, Edwin V. BonillaICML 2023 · 46 citations
- CUTS: Neural Causal Discovery from Irregular Time-Series DataYuxiao Cheng, Runzhao Yang, Tingxiong Xiao, Zongren Li et al.ICLR 2023 · 9 citations
- Predictive Coding beyond CorrelationsTommaso Salvatori, Luca Pinchetti, Amine M'Charrak, Beren Millidge et al.ICML 2024 · 6 citations
- Optimal Transport for Structure Learning Under Missing DataVy Vo, He Zhao, Trung Le, Edwin V. Bonilla et al.ICML 2024 · 6 citations
- Causal Reasoning in the Presence of Latent Confounders via Neural ADMG LearningMatthew Ashman, Chao Ma, Agrin Hilmkil, Joel Jennings et al.ICLR 2023 · 2 citations
Builds on4
- Gradient-Based Neural DAG LearningSébastien Lachapelle, Philippe Brouillard, Tristan Deleu, Simon Lacoste-JulienICLR 2020 · 337 citations
- SLAPS: Self-Supervision Improves Structure Learning for Graph Neural NetworksBahare Fatemi, Layla El Asri, Seyed Mehran KazemiNeurIPS 2021 · 220 citations
- Implicit Graph Neural NetworksFangda Gu, Heng Chang, Wenwu Zhu, Somayeh Sojoudi et al.NeurIPS 2020 · 188 citations
- CASTLE: Regularization via Auxiliary Causal Graph DiscoveryTrent Kyono, Yao Zhang, Mihaela van der SchaarNeurIPS 2020 · 82 citations
Related papers
- Filling the G_ap_s: Multivariate Time Series Imputation by Graph Neural NetworksAndrea Cini, Ivan Marisca, Cesare AlippiICLR 2022 · 179 citations
- Networked Time Series Imputation via Position-aware Graph Enhanced Variational AutoencodersDingsu Wang, Yuchen Yan, Ruizhong Qiu, Yada Zhu et al.KDD 2023 · 26 citations
- Missing Value Imputation on Multidimensional Time SeriesParikshit Bansal, Prathamesh Deshpande, Sunita SarawagiVLDB 2021 · 90 citations
- How to deal with missing data in supervised deep learning?Niels Bruun Ipsen, Pierre-Alexandre Mattei, Jes FrellsenICLR 2022 · 39 citations
- Mining of Switching Sparse Networks for Missing Value Imputation in Multivariate Time SeriesKohei Obata, Koki Kawabata, Yasuko Matsubara, Yasushi SakuraiKDD 2024 · 6 citations
