Learning Topology-Driven Multi-Subspace Fusion for Grassmannian Deep Networks
Xuan Yu, Tianyang Xu
Abstract
Grassmannian manifold offers a powerful carrier for geometric representation learning by modelling high-dimensional data as low-dimensional subspaces. However, existing approaches predominantly rely on static single-subspace representations, neglecting the dynamic interplay between multiple subspaces critical for capturing complex geometric structures. To address this limitation, we propose a topologydriven multi-subspace fusion framework that enables adaptive subspace collaboration on the Grassmannian. Our solution introduces two key innovations: (1) Inspired by the Kolmogorov-Arnold representation theorem, an adaptive multi-subspace modelling mechanism is proposed that dynamically selects and weights task-relevant subspaces via topological convergence analysis, and (2) a multi-subspace interaction block that fuses heterogeneous geometric representations through Fréchet mean optimisation on the manifold. Theoretically, we establish the convergence guarantees of adaptive subspaces under a projection metric topology, ensuring stable gradient-based optimisation. Practically, we integrate Riemannian batch normalisation and mutual information regularisation to enhance discriminability and robustness. Extensive experiments on 3D action recognition (HDM05, FPHA), EEG classification (MAMEM-SSVEPII), and graph tasks demonstrate state-of-the-art performance. Our work not only advances geometric deep learning but also successfully adapts the proven multi-channel interaction philosophy of Euclidean networks to non-Euclidean domains, achieving superior discriminability and interpretability.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on3
- CLUB: A Contrastive Log-ratio Upper Bound of Mutual InformationPengyu Cheng, Weituo Hao, Shuyang Dai, Jiachang Liu et al.ICML 2020 · 512 citations
- MAtt: A Manifold Attention Network for EEG DecodingYue-Ting Pan, Jing-Lun Chou, Chun-Shu WeiNeurIPS 2022 · 105 citations
- Riemannian Local Mechanism for SPD Neural NetworksZiheng Chen, Tianyang Xu, Xiao-Jun Wu, Rui Wang et al.AAAI 2023 · 34 citations
Related papers
- Gyrogroup Batch NormalizationZiheng Chen, Yue Song, Xiaojun Wu, Nicu SebeICLR 2025
- Riemannian Embedding Banks for Common Spatial Patterns with EEG-based SPD Neural NetworksYoon-Je Suh, Byung Hyung KimAAAI 2021 · 41 citations
- Get the Best of Both Worlds: Improving Accuracy and Transferability by Grassmann Class RepresentationHaoqi Wang, Zhizhong Li, Wayne ZhangICCV 2023 · 5 citations
- SPD domain-specific batch normalization to crack interpretable unsupervised domain adaptation in EEGReinmar J. Kobler, Jun-ichiro Hirayama, Qibin Zhao, Motoaki KawanabeNeurIPS 2022 · 102 citations
- Dual Principal Component Pursuit for Robust Subspace Learning: Theory and Algorithms for a Holistic ApproachTianyu Ding, Zhihui Zhu, René Vidal, Daniel P. RobinsonICML 2021 · 6 citations
