Robust Learning of Fixed-Structure Bayesian Networks in Nearly-Linear Time
Yu Cheng, Honghao Lin
Abstract
We study the problem of learning Bayesian networks where an -fraction of the samples are adversarially corrupted. We focus on the fully-observable case where the underlying graph structure is known. In this work, we present the first nearly-linear time algorithm for this problem with a dimension-independent error guarantee. Previous robust algorithms with comparable error guarantees are slower by at least a factor of , where is the number of variables in the Bayesian network and is the fraction of corrupted samples. Our algorithm and analysis are considerably simpler than those in previous work. We achieve this by establishing a direct connection between robust learning of Bayesian networks and robust mean estimation. As a subroutine in our algorithm, we develop a robust mean estimation algorithm whose runtime is nearly-linear in the number of nonzeros in the input samples, which may be of independent interest.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 12dd2e43-4b4c-4984-b81e-af9dc090a995Cited by top-tier papers1
Ask how each one uses itBuilds on4
- High-dimensional Robust Mean Estimation via Gradient DescentYu Cheng, Ilias Diakonikolas, Rong Ge, Mahdi SoltanolkotabiICML 2020 · 33 citations
- List-Decodable Mean Estimation in Nearly-PCA TimeIlias Diakonikolas, Daniel Kane, Daniel Kongsgaard, Jerry Li et al.NeurIPS 2021 · 18 citations
- Robust Gaussian Covariance Estimation in Nearly-Matrix Multiplication TimeJerry Li, Guanghao YeNeurIPS 2020 · 13 citations
- List Decodable Mean Estimation in Nearly Linear TimeYeshwanth Cherapanamjeri, Sidhanth Mohanty, Morris YauFOCS 2020 · 13 citations
Related papers
- Robust Learning of Mixtures of GaussiansDaniel M. KaneSODA 2021 · 12 citations
- Distributionally Robust Skeleton Learning of Discrete Bayesian NetworksYeshu Li, Brian D. ZiebartNeurIPS 2023 · 1 citation
- Near-Optimal Algorithms for Gaussians with Huber Contamination: Mean Estimation and Linear RegressionIlias Diakonikolas, Daniel Kane, Ankit Pensia, Thanasis PittasNeurIPS 2023 · 9 citations
- Robust Generalized Method of Moments: A Finite Sample ViewpointDhruv Rohatgi, Vasilis SyrgkanisNeurIPS 2022 · 3 citations
- A Subquadratic Time Algorithm for Robust Sparse Mean EstimationAnkit PensiaICML 2024 · 1 citation
