Sequential Information Bottleneck Fusion: Towards Robust and Generalizable Multi-Modal Brain Tumor Segmentation
TIANYI LIU, Xi Yang, Wei Wang, Anh Nguyen, Haochuan Jiang, Kaizhu Huang
摘要
Brain tumor segmentation in multi-modal MRIs poses significant challenges when one or more modalities are missing. Recent approaches commonly employ parallel fusion strategies; however, these methods often risk losing crucial shared information across modalities, which can degrade segmentation performance. In this paper, we advocate leveraging sequential information bottleneck fusion to effectively preserve shared information across modalities. From an informationtheoretic perspective, sequential fusion not only produces more robust fused representations in missing-data scenarios but also achieves a tighter generalization upper bound compared to parallel fusion approaches. Building on this principle, we propose the Sequential Multi-modal Segmentation Network (SMSN), which integrates an Information-Bottleneck Fusion Module (IBFM). The IBFM sequentially extracts modality-common features while reconstructing modality-specific features through a dedicated feature extraction module. Extensive experiments on the BRATS18 and BRATS20 glioma datasets demonstrate that SMSN consistently outperforms traditional parallel fusion-based baselines, achieving exceptional robustness in diverse missing-modality settings. Furthermore, SMSN exhibits superior cross-domain generalization, as evidenced by its ability to transfer a trained model from BRATS20 to a brain metastasis dataset without fine-tuning. RELATED WORK MULTI-MODAL BRAIN TUMOR SEGMENTATION Multi-modal MRI provides complementary information for brain tumor segmentation (Shaker et al., 2024; Fang et al., 2025) , but handling missing modalities remains a major challenge in clinical prac-
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper8
- RFNet: Region-aware Fusion Network for Incomplete Multi-modal Brain Tumor SegmentationYuhang Ding, Xin Yu, Yi YangICCV 2021 · 被引用 160 次
- M3AE: Multimodal Representation Learning for Brain Tumor Segmentation with Missing ModalitiesHong Liu, Dong Wei, Donghuan Lu, Jinghan Sun 等AAAI 2023 · 被引用 101 次
- Neuro-Inspired Information-Theoretic Hierarchical Perception for Multimodal LearningXiongye Xiao, Gengshuo Liu, Gaurav Gupta, Defu Cao 等ICLR 2024 · 被引用 32 次
- Photon: Speedup Volume Understanding with Efficient Multimodal Large Language ModelsChengyu Fang, Heng Guo, Zheng Jiang, Chunming He 等ICLR 2026 · 被引用 10 次
- Toward Fair and Accurate Cross-Domain Medical Image Segmentation: a Vlm-Driven Active Domain Adaptation ParadigmHongqiu Wang, Wu Chen, Xiangde Luo, Zhaohu Xing 等ICCV 2025 · 被引用 3 次
相关 Paper
- Virtual Nodes Guided Dynamic Graph Neural Network for Brain Tumor Segmentation with Missing ModalitiesSha Tao, Jiao Pan, Yu Guo, Chao YaoCVPR 2026
- Uni-Encoder Meets Multi-Encoders: Representation Before Fusion for Brain Tumor Segmentation with Missing ModalitiesPeibo Song, Xiaotian Xue, Jinshuo Zhang, Zihao Wang 等CVPR 2026
- TMFormer: Token Merging Transformer for Brain Tumor Segmentation with Missing ModalitiesZheyu Zhang, Gang Yang, Yueyi Zhang, Huanjing Yue 等AAAI 2024 · 被引用 29 次
- Semantic-guided Masked Mutual Learning for Multi-modal Brain Tumor Segmentation with Arbitrary Missing ModalitiesGuoyan Liang, Qin Zhou, Zhe Wang, Jingyuan Chen 等AAAI 2025
- Incomplete Multi-modal Brain Tumor Segmentation via Learnable Sorting State Space ModelZheyu Zhang, Yayuan Lu, Feipeng Ma, Yueyi Zhang 等CVPR 2025
