Toward a Training-Free Plug-and-Play Refinement Framework for Infrared and Visible Image Registration and Fusion
Yating Liu, Yang Zou, Xingyuan Li, Xingyue Zhu, Kaiqi Han, Zhiying Jiang, Long Ma, Jinyuan Liu
Abstract
Infrared and Visible Image Fusion (IVIF) under unregistered conditions has been of great interest in various visual tasks under challenging environments. While existing approaches often demonstrate promising results on specific benchmarks, they tend to exhibit performance drops in unseen scenarios and incur high computational overhead when retrained on new datasets. To address these challenges, we propose TRACE, a Training-free Reinforcement-based Alignment method for Cross-modality Enhancement, which incorporates Evaluator, a rewarding network, into an evaluation-driven Reinforcement Learning (RL) framework, enabling efficient and plug-and-play refinement of any existing registration approach. Specifically, TRACE constructs the Evaluator network to assess the alignment quality of the given registration model, generating confidence scores and adjustment masks via spatial and channel attention. Leveraging these cues as RL rewards, TRACE iteratively refines the registration network to mitigate misalignments until the accumulated improvement is satisfied. Due to its training-free and plug-and-play nature, TRACE notably enhances fusion results across diverse and unseen scenarios. TRACE achieves impressive improvements in different methods across diverse datasets with minimal computational cost. The project page is available at https://github.com/pubyLu/TRACE.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Cited by top-tier papers9
- Toward Real-world Infrared Image Super-Resolution: A Unified Autoregressive Framework and Benchmark DatasetYang Zou, Jun Ma, Zhidong Jiao, Xingyuan Li et al.CVPR 2026 · 4 citations
- HATIR: Heat-Aware Diffusion for Turbulent Infrared Video Super-ResolutionYang Zou, Xingyue Zhu, Kaiqi Han, Jun Ma et al.AAAI 2026 · 3 citations
- From 2D Grids to 1D Tokens: Reforming Shared Representations for Multimodal Image FusionYuchen Xian, Yunqiu Xu, Yang He, Yi YangICML 2026 · 2 citations
- ControlFuse: Instruction-guided Multi-Granularity Controllable Image FusionLibo Zhao, Xiaoli Zhang, Zeyu WangAAAI 2026
- FlowAnyTime: Efficient Fine-tuning with Intra-Inter Frame Distillation for All-Weather Optical Flow EstimationZixu Wang, Hongye Chen, Xiaochun Zou, Congxuan Zhang et al.AAAI 2026
Related papers
- FusionRegister: Every Infrared and Visible Image Fusion Deserves RegistrationCongcong Bian, Haolong Ma, Hui Li, Zhongwei Shen et al.CVPR 2026 · 3 citations
- Beyond Strict Pairing: Arbitrarily Paired Training for High-Performance Infrared and Visible Image FusionYanglin Deng, Tianyang Xu, Chunyang Cheng, Hui Li et al.CVPR 2026
- Domain Adaptation Guided Infrared and Visible Image FusionTianwei Guan, Haozhen Wei, Yuhan Zhou, Jun Ma et al.AAAI 2026
- DetFusion: A Detection-driven Infrared and Visible Image Fusion NetworkYiming Sun, Bing Cao, Pengfei Zhu, Qinghua HuACM MM 2022 · 165 citations
- CtrlFuse: Mask-Prompt Guided Controllable Infrared and Visible Image FusionYiming Sun, Yuan Ruan, Qinghua Hu, Pengfei ZhuAAAI 2026
