Brain Networks Should Be Learned, Not Constructed
Liang Yang, Shuai Zhai, Ziyi Ma, Jiaming Zhuo, Di Jin, Chuan Wang, Zhen Wang, Xiaochun Cao
Abstract
The construction of the brain functional network often follows the hand-crafted Correlation Coefficients without any learnable components. Meanwhile, most efforts are made to the models, such as graph neural networks, that make predictions with the constructed brain network as input. Unfortunately, the fixed brain network may lose critical information during construction and lead to difficulty in performance improvement, even with deliberately designed graph models. From this perspective, the current situation is similar to the machine learning community, i.e., hand-crafted features and learnable predictors, before the advent of representation learning. In fact, the brain network can be regarded as a graph-structured learnable representation of the brain. By drawing on representation learning, this paper presents the Brain Representation (BRep) learning problem. To this end, the widely used linear and nonlinear correlations are enhanced to be high-order, parametric, and learnable. The expressive brain representation shifts the heavy computational burden away from downstream architectures, enabling a simple yet accurate predictor. Theoretical analysis guarantees the model's universal approximation to any U/V-statistics. Extensive evaluations demonstrate that BRep possesses superior performance, high efficiency, and interpretability. The code is available at https://github.com/Kevin-916/BRep-demo/.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on15
- Do Transformers Really Perform Badly for Graph Representation?Chengxuan Ying, Tianle Cai, Shengjie Luo, Shuxin Zheng et al.NeurIPS 2021 · 1,632 citations
- Rethinking Graph Transformers with Spectral AttentionDevin Kreuzer, Dominique Beaini, William L. Hamilton, Vincent Létourneau et al.NeurIPS 2021 · 854 citations
- Graph Structure Learning for Robust Graph Neural NetworksWei Jin, Yao Ma, Xiaorui Liu, Xianfeng Tang et al.KDD 2020 · 604 citations
- Iterative Deep Graph Learning for Graph Neural Networks: Better and Robust Node EmbeddingsYu Chen, Lingfei Wu, Mohammed J. ZakiNeurIPS 2020 · 559 citations
- Representing Long-Range Context for Graph Neural Networks with Global AttentionZhanghao Wu, Paras Jain, Matthew A. Wright, Azalia Mirhoseini et al.NeurIPS 2021 · 450 citations
Related papers
- NAR-Former V2: Rethinking Transformer for Universal Neural Network Representation LearningYun Yi, Haokui Zhang, Rong Xiao, Nannan Wang et al.NeurIPS 2023 · 8 citations
- Do We Really Need Message Passing in Brain Network Modeling?Liang Yang, Yuwei Liu, Jiaming Zhuo, Di Jin et al.ICML 2025
- Rethinking the Power of Graph Canonization in Graph Representation Learning with StabilityZehao Dong, Muhan Zhang, Philip R. O. Payne, Michael A. Province et al.ICLR 2024 · 1 citation
- Permutation-Invariant Variational Autoencoder for Graph-Level Representation LearningRobin Winter, Frank Noé, Djork-Arné ClevertNeurIPS 2021 · 43 citations
- Intent Distribution based Bipartite Graph Representation LearningHaojie Li, Wei Wei, Guanfeng Liu, Jinhuan Liu et al.SIGIR 2024 · 4 citations
