Searching a Hierarchically Aggregated Fusion Architecture for Fast Multi-Modality Image Fusion
Risheng Liu, Zhu Liu, Jinyuan Liu, Xin Fan
Abstract
Multi-modality image fusion refers to generating a complementary image that integrates typical characteristics from source images. In recent years, we have witnessed the remarkable progress of deep learning models for multi-modality fusion. Existing CNN-based approaches strain every nerve to design various architectures for realizing these tasks in an end-to-end manner. However, these handcrafted designs are unable to cope with the high demanding fusion tasks, resulting in blurred targets and lost textural details. To alleviate these issues, in this paper, we propose a novel approach, aiming at searching effective architectures according to various modality principles and fusion mechanisms.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get ad459778-57a5-48ff-9b81-1b8f03edcd91Cited by top-tier papers18
- Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object DetectionJinyuan Liu, Xin Fan, Zhanbo Huang, Guanyao Wu et al.CVPR 2022 · 929 citations
- DDFM: Denoising Diffusion Model for Multi-Modality Image FusionZixiang Zhao, Haowen Bai, Yuanzhi Zhu, Jiangshe Zhang et al.ICCV 2023 · 350 citations
- Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and SegmentationJinyuan Liu, Zhu Liu, Guanyao Wu, Long Ma et al.ICCV 2023 · 287 citations
- Equivariant Multi-Modality Image FusionZixiang Zhao, Haowen Bai, Jiangshe Zhang, Yulun Zhang et al.CVPR 2024 · 155 citations
- E2E-MFD: Towards End-to-End Synchronous Multimodal Fusion DetectionJiaqing Zhang, Mingxiang Cao, Weiying Xie, Jie Lei et al.NeurIPS 2024 · 68 citations
Related papers
- Decomposition-Based Variational Network for Multi-Contrast MRI Super-Resolution and ReconstructionPengcheng Lei, Faming Fang, Guixu Zhang, Tieyong ZengICCV 2023 · 39 citations
- DCAFuse: Dual-Branch Diffusion-CNN Complementary Feature Aggregation Network for Multi-Modality Image FusionXudong Lu, Yuqi Jiang, Haiwen Hong, Qi Sun et al.ACM MM 2024 · 8 citations
- DetFusion: A Detection-driven Infrared and Visible Image Fusion NetworkYiming Sun, Bing Cao, Pengfei Zhu, Qinghua HuACM MM 2022 · 165 citations
- HEALNet: Multimodal Fusion for Heterogeneous Biomedical DataKonstantin Hemker, Nikola Simidjievski, Mateja JamnikNeurIPS 2024 · 80 citations
- Mutual-Guided Dynamic Network for Image FusionYuanshen Guan, Ruikang Xu, Mingde Yao, Lizhi Wang et al.ACM MM 2023 · 24 citations
