UniFuse: A Unified All-In-One Framework for Multi-Modal Medical Image Fusion Under Diverse Degradations and Misalignments
Dayong Su, Yafei Zhang, Huafeng Li, Jinxing Li, Yu Liu
Abstract
Current multimodal medical image fusion typically assumes that source images are of high quality and perfectly aligned at the pixel level. Its effectiveness heavily relies on these conditions and often deteriorates when handling misaligned or degraded medical images. To address this, we propose UniFuse, a general fusion framework. By embedding a degradation-aware prompt learning module, UniFuse seamlessly integrates multi-directional information from input images and correlates cross-modal alignment with restoration, enabling joint optimization of both tasks within a unified framework. Additionally, we design an Omni Unified Feature Representation scheme, which leverages Spatial Mamba to encode multi-directional features and mitigate modality differences in feature alignment. To enable simultaneous restoration and fusion within an All-in-One configuration, we propose a Universal Feature Restoration & Fusion module, incorporating the Adaptive LoRA Synergistic Network (ALSN) based on LoRA principles. By leveraging ALSN's adaptive feature representation along with degradation-type guidance, we enable joint restoration and fusion within a single-stage framework. Compared to staged approaches, UniFuse unifies alignment, restoration, and fusion within a single framework. Experimental results across multiple datasets demonstrate the method's effectiveness and significant advantages over existing approaches. code is available at https://github.com/slrl123/UniFuse.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Pansharpening for Thin-Cloud Contaminated Remote Sensing Images: A Unified Framework and Benchmark DatasetSongcheng Du, Yang Zou, Jiaxin Li, Mingxuan Liu et al.AAAI 2026 · 3 citations
- Difference-Aware Decision Learning for Multimodal Image FusionHao Pan, Jian Dai, Yuan Sun, Zhenwen Ren et al.ICML 2026
Builds on5
- Equivariant Multi-Modality Image FusionZixiang Zhao, Haowen Bai, Jiangshe Zhang, Yulun Zhang et al.CVPR 2024 · 155 citations
- Correlation-aware Coarse-to-fine MLPs for Deformable Medical Image RegistrationMingyuan Meng, Dagan Feng, Lei Bi, Jinman KimCVPR 2024 · 47 citations
- BSAFusion: A Bidirectional Stepwise Feature Alignment Network for Unaligned Medical Image FusionHuafeng Li, Dayong Su, Qing Cai, Yafei ZhangAAAI 2025 · 43 citations
- A Robust Mutual-Reinforcing Framework for 3D Multi-Modal Medical Image Fusion Based on Visual-Semantic ConsistencyHao Zhang, Xuhui Zuo, Huabing Zhou, Tao Lu et al.AAAI 2024 · 20 citations
- Learning Federated Visual Prompt in Null Space for MRI ReconstructionChun-Mei Feng, Bangjun Li, Xinxing Xu, Yong Liu et al.CVPR 2023
Related papers
- UniFusion: A Unified Image Fusion Framework with Robust Representation and Source-Aware PreservationXingyuan Li, Songcheng Du, Yang Zou, Haoyuan Xu et al.CVPR 2026 · 6 citations
- EndoIR: Degradation-Agnostic All-in-One Endoscopic Image Restoration via Noise-Aware Routing DiffusionTong Chen, Xinyu Ma, Long Bai, Wenyang Wang et al.AAAI 2026
- SAMora: Enhancing SAM through Hierarchical Self-Supervised Pre-Training for Medical ImagesShuhang Chen, Hangjie Yuan, Pengwei Liu, Hanxue Gu et al.ICCV 2025 · 1 citation
- Cycle-Consistent Mamba-Based Registration-Fusion Joint Network for Unregistered Hyperspectral Image Super-ResolutionQuangui He, Jiahui Qu, Wenqian Dong, Song Xiao et al.ACM MM 2025
- Self-supervised Multiplex Consensus Mamba for General Image FusionYingying Wang, Rongjin Zhuang, Hui Zheng, Xuanhua He et al.AAAI 2026 · 2 citations
