Hierarchical Information Aggregation for Incomplete Multimodal Alzheimer's Disease Diagnosis
Chengliang Liu, Yuanxi Que, Qihao Xu, Yabo Liu, Jie Wen, Jinghua Wang, Xiaoling Luo
Abstract
Alzheimer's Disease (AD) poses a significant health threat to the aging population, underscoring the critical need for early diagnosis to delay disease progression and improve patient quality of life. Recent advances in heterogeneous multimodal artificial intelligence (AI) have facilitated comprehensive joint diagnosis, yet practical clinical scenarios frequently encounter incomplete modalities due to factors like high acquisition costs or radiation risks. Moreover, traditional convolution-based architecture face inherent limitations in capturing long-range dependencies and handling heterogeneous medical data efficiently. To address these challenges, in our proposed heterogeneous multimodal diagnostic framework (HAD), we develop a multi-view Hilbert curve-based Mamba block and a hierarchical spatial feature extraction module to simultaneously capture local spatial features and global dependencies, effectively alleviating spatial discontinuities introduced by voxel serialization. Furthermore, to balance semantic consistency and modal specificity, we build a unified mutual information learning objective in the heterogeneous multimodal embedding space, which maintains effective learning of modality-specific information to avoid modality collapse caused by model preference. Extensive experiments demonstrate that our HAD significantly outperforms state-of-the-art methods in various modality-missing scenarios, providing an efficient and reliable solution for early-stage AD diagnosis.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on11
- Efficiently Modeling Long Sequences with Structured State SpacesAlbert Gu, Karan Goel, Christopher RéICLR 2022 · 3,482 citations
- VMamba: Visual State Space ModelYue Liu, Yunjie Tian, Yuzhong Zhao, Hongtian Yu et al.NeurIPS 2024 · 3,199 citations
- Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space ModelLianghui Zhu, Bencheng Liao, Qian Zhang, Xinlong Wang et al.ICML 2024 · 1,725 citations
- HiPPO: Recurrent Memory with Optimal Polynomial ProjectionsAlbert Gu, Tri Dao, Stefano Ermon, Atri Rudra et al.NeurIPS 2020 · 1,100 citations
- M3Care: Learning with Missing Modalities in Multimodal Healthcare DataChaohe Zhang, Xu Chu, Liantao Ma, Yinghao Zhu et al.KDD 2022 · 78 citations
Related papers
- Joint Adaptation of Uni-modal Foundation Models for Multi-modal Alzheimer's Disease DiagnosisWentao Gu, Yuquan Li, Xinyang Jiang, Zilong Wang et al.ICLR 2026
- Learning Multi-Modal Biomarker Representations via Globally Aligned Longitudinal EnrichmentsLyujian Lu, Saad Elbeleidy, Lauren Zoe Baker, Hua WangAAAI 2020 · 7 citations
- Flex-MoE: Modeling Arbitrary Modality Combination via the Flexible Mixture-of-ExpertsSukwon Yun, Inyoung Choi, Jie Peng, Yangfan Wu et al.NeurIPS 2024 · 98 citations
- Integrating Static and Dynamic Data for Improved Prediction of Cognitive Declines Using Augmented Genotype-Phenotype RepresentationsHoon Seo, Lodewijk Brand, Hua Wang, Feiping NieAAAI 2021 · 2 citations
- EccoMamba: Enhanced Cross-hierarchical Continuity Orthogonal Mamba for Medical Image SegmentationJunlin Xu, Jincan Li, Feifei Cui, Zhuang Zhang et al.AAAI 2026
