Fast Projected Newton-like Method for Precision Matrix Estimation under Total Positivity
Jianfeng Cai, José Vinícius de Miranda Cardoso, Daniel P. Palomar, Jiaxi Ying
Abstract
We study the problem of estimating precision matrices in Gaussian distributions that are multivariate totally positive of order two (). The precision matrix in such a distribution is an M-matrix. This problem can be formulated as a sign-constrained log-determinant program. Current algorithms are designed using the block coordinate descent method or the proximal point algorithm, which becomes computationally challenging in high-dimensional cases due to the requirement to solve numerous nonnegative quadratic programs or large-scale linear systems. To address this issue, we propose a novel algorithm based on the two-metric projection method, incorporating a carefully designed search direction and variable partitioning scheme. Our algorithm substantially reduces computational complexity, and its theoretical convergence is established. Experimental results on synthetic and real-world datasets demonstrate that our proposed algorithm provides a significant improvement in computational efficiency compared to the state-of-the-art methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 05eee1e3-ce7b-45c3-be9c-1df73b67e882Cited by top-tier papers4
- Learning Bipartite Graphs: Heavy Tails and Multiple ComponentsJosé Vinícius de Miranda Cardoso, Jiaxi Ying, Daniel P. PalomarNeurIPS 2022 · 14 citations
- Adaptive Estimation of Graphical Models under Total PositivityJiaxi Ying, José Vinícius de Miranda Cardoso, Daniel P. PalomarICML 2023 · 6 citations
- Learning Large-Scale MTP2 Gaussian Graphical Models via Bridge-Block DecompositionXiwen Wang, Jiaxi Ying, Daniel P. PalomarNeurIPS 2023 · 5 citations
- A Fast and Provable Algorithm for Sparse Phase RetrievalJian-Feng Cai, Yu Long, Ruixue Wen, Jiaxi YingICLR 2024 · 5 citations
Builds on4
- Nonconvex Sparse Graph Learning under Laplacian Constrained Graphical ModelJiaxi Ying, José Vinícius de Miranda Cardoso, Daniel P. PalomarNeurIPS 2020 · 71 citations
- Learning Some Popular Gaussian Graphical Models without Condition Number BoundsJonathan A. Kelner, Frederic Koehler, Raghu Meka, Ankur MoitraNeurIPS 2020 · 38 citations
- Learning Bipartite Graphs: Heavy Tails and Multiple ComponentsJosé Vinícius de Miranda Cardoso, Jiaxi Ying, Daniel P. PalomarNeurIPS 2022 · 14 citations
- Adaptive Estimation of Graphical Models under Total PositivityJiaxi Ying, José Vinícius de Miranda Cardoso, Daniel P. PalomarICML 2023 · 6 citations
Related papers
- Inexact Newton-type Methods for Optimisation with Nonnegativity ConstraintsOscar Smee, Fred RoostaICML 2024 · 1 citation
- Positive Definite Sparse Covariance Estimation via Dual Space OptimizationFengpei Li, Wenfu Xia, Ziping ZhaoAAAI 2026
- Solving Dense Linear Systems Faster Than via PreconditioningMichal Derezinski, Jiaming YangSTOC 2024
- Breaking the Barrier of Self-Concordant Barriers: Faster Interior Point Methods for M-MatricesAdrian VladuSTOC 2025
- A Feasible Level Proximal Point Method for Nonconvex Sparse Constrained OptimizationDigvijay Boob, Qi Deng, Guanghui Lan, Yilin WangNeurIPS 2020 · 12 citations
