Neurodynamics-Driven Coupled Neural P Systems for Multi-Focus Image Fusion
Bo Li, Yunkuo Lei, Tingting Bao, Hang Yan, Yaxian Wang, Weiping Fu, Lingling Zhang, Jun Liu
Abstract
Multi-focus image fusion (MFIF) is a crucial technique in image processing, with a key challenge being the generation of decision maps with precise boundaries. However, traditional methods based on heuristic rules and deep learning methods with black-box mechanisms are difficult to generate high-quality decision maps. To overcome this challenge, we introduce neurodynamics-driven coupled neural P (CNP) systems, which are third-generation neural computation models inspired by spiking mechanisms, to enhance the accuracy of decision maps. Specifically, we first conduct an in-depth analysis of the model's neurodynamics to identify the constraints between the network parameters and the input signals. This solid analysis avoids abnormal continuous firing of neurons and ensures the model accurately distinguishes between focused and unfocused regions, generating high-quality decision maps for MFIF. Based on this analysis, we propose a Neurodynamics-Driven CNP Fusion model (ND-CNPFuse) tailored for the challenging MFIF task. Unlike current ideas of decision map generation, ND-CNPFuse distinguishes between focused and unfocused regions by mapping the source image into interpretable spike matrices. By comparing the number of spikes, an accurate decision map can be generated directly without any post-processing. Extensive experimental results show that ND-CNPFuse achieves new state-of-the-art performance on four classical MFIF datasets, including Lytro, MFFW, MFI-WHU, and Real-MFF. The code is available at https://github.com/MorvanLi/ND-CNPFuse.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on7
- Rethinking the Image Fusion: A Fast Unified Image Fusion Network based on Proportional Maintenance of Gradient and IntensityHao Zhang, Han Xu, Yang Xiao, Xiaojie Guo et al.AAAI 2020 · 583 citations
- Text-DiFuse: An Interactive Multi-Modal Image Fusion Framework based on Text-modulated Diffusion ModelHao Zhang, Lei Cao, Jiayi MaNeurIPS 2024 · 69 citations
- Task-Customized Mixture of Adapters for General Image FusionPengfei Zhu, Yang Sun, Bing Cao, Qinghua HuCVPR 2024 · 58 citations
- Conditional Controllable Image FusionBing Cao, Xingxin Xu, Pengfei Zhu, Qilong Wang et al.NeurIPS 2024 · 29 citations
- Mutual-Guided Dynamic Network for Image FusionYuanshen Guan, Ruikang Xu, Mingde Yao, Lizhi Wang et al.ACM MM 2023 · 24 citations
Related papers
- Multi-Focus Image Fusion via Explicit Defocus Blur ModellingYuhui Quan, Xi Wan, Zitao Tang, Jinxiu Liang et al.AAAI 2025 · 12 citations
- DTMNet: A Discrete Tchebichef Moments-based Deep Neural Network for Multi-focus Image FusionBin Xiao, Haifeng Wu, Xiuli BiICCV 2021 · 12 citations
- Seeing Through Blur: Tackling Defocus in Spike-Based ImagingXiantao Ma, Siwei Dong, Lin Zhu, Lizhi Wang et al.CVPR 2026
- NeuSpike-Net: High Speed Video Reconstruction via Bio-inspired Neuromorphic CamerasLin Zhu, Jianing Li, Xiao Wang, Tiejun Huang et al.ICCV 2021 · 55 citations
- Oligodendrocyte-Driven Spiking Neural ModelMengqiao Han, Liyuan Pan, Xiabi Liu, Hongming ZhangAAAI 2026
