Sequential Information Bottleneck Fusion: Towards Robust and Generalizable Multi-Modal Brain Tumor Segmentation
TIANYI LIU, Xi Yang, Wei Wang, Anh Nguyen, Haochuan Jiang, Kaizhu Huang
Abstract
Brain tumor segmentation in multi-modal MRIs poses significant challenges when one or more modalities are missing. Recent approaches commonly employ parallel fusion strategies; however, these methods often risk losing crucial shared information across modalities, which can degrade segmentation performance. In this paper, we advocate leveraging sequential information bottleneck fusion to effectively preserve shared information across modalities. From an informationtheoretic perspective, sequential fusion not only produces more robust fused representations in missing-data scenarios but also achieves a tighter generalization upper bound compared to parallel fusion approaches. Building on this principle, we propose the Sequential Multi-modal Segmentation Network (SMSN), which integrates an Information-Bottleneck Fusion Module (IBFM). The IBFM sequentially extracts modality-common features while reconstructing modality-specific features through a dedicated feature extraction module. Extensive experiments on the BRATS18 and BRATS20 glioma datasets demonstrate that SMSN consistently outperforms traditional parallel fusion-based baselines, achieving exceptional robustness in diverse missing-modality settings. Furthermore, SMSN exhibits superior cross-domain generalization, as evidenced by its ability to transfer a trained model from BRATS20 to a brain metastasis dataset without fine-tuning. RELATED WORK MULTI-MODAL BRAIN TUMOR SEGMENTATION Multi-modal MRI provides complementary information for brain tumor segmentation (Shaker et al., 2024; Fang et al., 2025) , but handling missing modalities remains a major challenge in clinical prac-
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9006d0d8-c100-48cc-8d1b-b79f9900a21bBuilds on8
- RFNet: Region-aware Fusion Network for Incomplete Multi-modal Brain Tumor SegmentationYuhang Ding, Xin Yu, Yi YangICCV 2021 · 160 citations
- M3AE: Multimodal Representation Learning for Brain Tumor Segmentation with Missing ModalitiesHong Liu, Dong Wei, Donghuan Lu, Jinghan Sun et al.AAAI 2023 · 101 citations
- Neuro-Inspired Information-Theoretic Hierarchical Perception for Multimodal LearningXiongye Xiao, Gengshuo Liu, Gaurav Gupta, Defu Cao et al.ICLR 2024 · 32 citations
- Photon: Speedup Volume Understanding with Efficient Multimodal Large Language ModelsChengyu Fang, Heng Guo, Zheng Jiang, Chunming He et al.ICLR 2026 · 10 citations
- Toward Fair and Accurate Cross-Domain Medical Image Segmentation: a Vlm-Driven Active Domain Adaptation ParadigmHongqiu Wang, Wu Chen, Xiangde Luo, Zhaohu Xing et al.ICCV 2025 · 3 citations
Related papers
- Virtual Nodes Guided Dynamic Graph Neural Network for Brain Tumor Segmentation with Missing ModalitiesSha Tao, Jiao Pan, Yu Guo, Chao YaoCVPR 2026
- Uni-Encoder Meets Multi-Encoders: Representation Before Fusion for Brain Tumor Segmentation with Missing ModalitiesPeibo Song, Xiaotian Xue, Jinshuo Zhang, Zihao Wang et al.CVPR 2026
- TMFormer: Token Merging Transformer for Brain Tumor Segmentation with Missing ModalitiesZheyu Zhang, Gang Yang, Yueyi Zhang, Huanjing Yue et al.AAAI 2024 · 29 citations
- Semantic-guided Masked Mutual Learning for Multi-modal Brain Tumor Segmentation with Arbitrary Missing ModalitiesGuoyan Liang, Qin Zhou, Zhe Wang, Jingyuan Chen et al.AAAI 2025
- Incomplete Multi-modal Brain Tumor Segmentation via Learnable Sorting State Space ModelZheyu Zhang, Yayuan Lu, Feipeng Ma, Yueyi Zhang et al.CVPR 2025
