Fast and Stable Riemannian Metrics on SPD Manifolds via Cholesky Product Geometry
Ziheng Chen, Yue Song, Xiaojun Wu, Nicu Sebe
Abstract
Recent advances in Symmetric Positive Definite (SPD) matrix learning show that Riemannian metrics are fundamental to effective SPD neural networks. Motivated by this, we revisit the geometry of the Cholesky factors and uncover a simple product structure that enables convenient metric design. Building on this insight, we propose two fast and stable SPD metrics, Power--Cholesky Metric (PCM) and Bures--Wasserstein--Cholesky Metric (BWCM), derived via Cholesky decomposition. Compared with existing SPD metrics, the proposed metrics provide closed-form operators, computational efficiency, and improved numerical stability. We further apply our metrics to construct Riemannian Multinomial Logistic Regression (MLR) classifiers and residual blocks for SPD neural networks. Experiments on SPD deep learning, numerical stability analyses, and tensor interpolation demonstrate the effectiveness, efficiency, and robustness of our metrics. The code is available at https://github.com/GitZH-Chen/PCM_BWCM.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Proper Velocity Neural NetworksZiheng Chen, Zihan Su, Bernhard Schölkopf, Nicu SebeICLR 2026
- Riemannian Networks over Full-Rank Correlation MatricesZiheng Chen, Xiaojun Wu, Bernhard Schölkopf, Nicu SebeICML 2026
Builds on21
- Hyperbolic Neural Networks++Ryohei Shimizu, Yusuke Mukuta, Tatsuya HaradaICLR 2021 · 791 citations
- Flow Matching on General GeometriesRicky T. Q. Chen, Yaron LipmanICLR 2024 · 193 citations
- Mixed-curvature Variational AutoencodersOndrej Skopek, Octavian-Eugen Ganea, Gary BécigneulICLR 2020 · 122 citations
- MAtt: A Manifold Attention Network for EEG DecodingYue-Ting Pan, Jing-Lun Chou, Chun-Shu WeiNeurIPS 2022 · 105 citations
- SPD domain-specific batch normalization to crack interpretable unsupervised domain adaptation in EEGReinmar J. Kobler, Jun-ichiro Hirayama, Qibin Zhao, Motoaki KawanabeNeurIPS 2022 · 102 citations
Related papers
- Riemannian Multinomial Logistics Regression for SPD Neural NetworksZiheng Chen, Yue Song, Gaowen Liu, Ramana Rao Kompella et al.CVPR 2024
- Learning to Normalize on the SPD Manifold under Bures-Wasserstein GeometryRui Wang, Shaocheng Jin, Ziheng Chen, Xiaoqing Luo et al.CVPR 2025
- RMLR: Extending Multinomial Logistic Regression into General GeometriesZiheng Chen, Yue Song, Rui Wang, Xiaojun Wu et al.NeurIPS 2024 · 16 citations
- On Riemannian Optimization over Positive Definite Matrices with the Bures-Wasserstein GeometryAndi Han, Bamdev Mishra, Pratik Kumar Jawanpuria, Junbin GaoNeurIPS 2021 · 55 citations
- Riemannian Embedding Banks for Common Spatial Patterns with EEG-based SPD Neural NetworksYoon-Je Suh, Byung Hyung KimAAAI 2021 · 41 citations
