BrainHGT: A Hierarchical Graph Transformer for Interpretable Brain Network Analysis
Jiajun Ma, Yongchao Zhang, Chao Zhang, Zhao Lv, Shengbing Pei
Abstract
Graph Transformer shows remarkable potential in brain network analysis due to its ability to model graph structures and complex node relationships. Most existing methods typically model the brain as a flat network, ignoring its modular structure, and their attention mechanisms treat all brain region connections equally, ignoring distance-related node connection patterns. However, brain information processing is a hierarchical process that involves local and long-range interactions between brain regions, interactions between regions and sub-functional modules, and interactions among functional modules themselves. This hierarchical interaction mechanism enables the brain to efficiently integrate local computations and global information flow, supporting the execution of complex cognitive functions. To address this issue, we propose BrainHGT, a hierarchical Graph Transformer that simulates the brain’s natural information processing from local regions to global communities. Specifically, we design a novel long-short range attention encoder that utilizes parallel pathways to handle dense local interactions and sparse long-range connections, thereby effectively alleviating the over-globalizing issue. To further capture the brain’s modular architecture, we designe a prior-guided clustering module that utilizes a cross-attention mechanism to group brain regions into functional communities and leverage neuroanatomical prior to guide the clustering process, thereby improving the biological plausibility and interpretability. Experimental results indicate that our proposed method significantly improves performance of disease identification, and can reliably capture the sub-functional modules of the brain, demonstrating its interpretability.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c10e95ae-d343-40c0-8f6d-2cc0eb77b614Builds on3
- Brain Network TransformerXuan Kan, Wei Dai, Hejie Cui, Zilong Zhang et al.NeurIPS 2022 · 272 citations
- Less is More: on the Over-Globalizing Problem in Graph TransformersYujie Xing, Xiao Wang, Yibo Li, Hai Huang et al.ICML 2024
- Biologically Plausible Brain Graph TransformerCiyuan Peng, Yuelong Huang, Qichao Dong, Shuo Yu et al.ICLR 2025
Related papers
- Long-range Brain Graph TransformerShuo Yu, Shan Jin, Ming Li, Tabinda Sarwar et al.NeurIPS 2024 · 32 citations
- Make Model Transparent: Brain Network Analysis via Causal and Knowledge Graph LearningLingyuan Meng, Ke Liang, Hao Yu, Haotian Wang et al.AAAI 2026
- Enhancing Graph Transformers with Hierarchical Distance Structural EncodingYuankai Luo, Hongkang Li, Lei Shi, Xiao-Ming WuNeurIPS 2024 · 26 citations
- PhenoBrain: Phenotype-Conditioned Long-Range Communication for Multi-Modal Brain Network AnalysisLingyuan Meng, KE LIANG, Hao Li, Meng Liu et al.ICML 2026
- HINormer: Representation Learning On Heterogeneous Information Networks with Graph TransformerQiheng Mao, Zemin Liu, Chenghao Liu, Jianling SunWWW 2023 · 106 citations
