Parameter Estimation in DAGs from Incomplete Data via Optimal Transport
Vy Vo, Trung Le, Long Tung Vuong, He Zhao, Edwin V. Bonilla, Dinh Phung
Abstract
Estimating the parameters of a probabilistic directed graphical model from incomplete data is a long-standing challenge. This is because, in the presence of latent variables, both the likelihood function and posterior distribution are intractable without assumptions about structural dependencies or model classes. While existing learning methods are fundamentally based on likelihood maximization, here we offer a new view of the parameter learning problem through the lens of optimal transport. This perspective licenses a general framework that operates on any directed graphs without making unrealistic assumptions on the posterior over the latent variables or resorting to variational approximations. We develop a theoretical framework and support it with extensive empirical evidence demonstrating the versatility and robustness of our approach. Across experiments, we show that not only can our method effectively recover the ground-truth parameters but it also performs comparably or better than competing baselines on downstream applications.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext adb0800a-2925-495e-8901-82544a78fbc3Cited by top-tier papers2
- Optimal Transport for Structure Learning Under Missing DataVy Vo, He Zhao, Trung Le, Edwin V. Bonilla et al.ICML 2024 · 6 citations
- Causal Discovery in the Wild: A Voting-Theoretic Ensemble ApproachVy Vo, Haoxuan Li, Mingming GongICLR 2026
Builds on13
- Vector-quantized Image Modeling with Improved VQGANJiahui Yu, Xin Li, Jing Yu Koh, Han Zhang et al.ICLR 2022 · 753 citations
- Neural Topic Model via Optimal TransportHe Zhao, Dinh Phung, Viet Huynh, Trung Le et al.ICLR 2021 · 100 citations
- SQ-VAE: Variational Bayes on Discrete Representation with Self-annealed Stochastic QuantizationYuhta Takida, Takashi Shibuya, Wei-Hsiang Liao, Chieh-Hsin Lai et al.ICML 2022 · 99 citations
- The Usual Suspects? Reassessing Blame for VAE Posterior CollapseBin Dai, Ziyu Wang, David P. WipfICML 2020 · 89 citations
- Representing Mixtures of Word Embeddings with Mixtures of Topic EmbeddingsDongsheng Wang, Dandan Guo, He Zhao, Huangjie Zheng et al.ICLR 2022 · 56 citations
Related papers
- Transfer Learning on Edge Connecting Probability Estimation Under Graphon ModelYuyao Wang, Yu-Hung Cheng, Debarghya Mukherjee, Huimin ChengNeurIPS 2025 · 1 citation
- Markov Equivalence and Consistency in Differentiable Structure LearningChang Deng, Kevin Bello, Pradeep Ravikumar, Bryon AragamNeurIPS 2024 · 8 citations
- Generalized Variational Inference via Optimal TransportJinjin Chi, Zhichao Zhang, Zhiyao Yang, Jihong Ouyang et al.AAAI 2024 · 1 citation
- Graph Neural Networks with a Distribution of Parametrized GraphsSee Hian Lee, Feng Ji, Kelin Xia, Wee Peng TayICML 2024 · 2 citations
- OTLDA: A Geometry-aware Optimal Transport Approach for Topic ModelingViet Huynh, He Zhao, Dinh PhungNeurIPS 2020 · 29 citations
