SOMA: Feature Gradient Enhanced Affine-Flow Matching for SAR-Optical Registration
Haodong Wang, Tao Zhuo, Xiuwei Zhang, Hanlin Yin, Wencong Wu, Yanning Zhang
Abstract
Achieving pixel-level registration between SAR and optical images remains a challenging task due to their fundamentally different imaging mechanisms and visual characteristics. Although deep learning has achieved great success in many cross-modal tasks, its performance on SAR-Optical registration tasks is still unsatisfactory. Gradient-based information has traditionally played a crucial role in handcrafted descriptors by highlighting structural differences. However, such gradient cues have not been effectively leveraged in deep learning frameworks for SAR-Optical image matching. To address this gap, we propose SOMA, a dense registration framework that integrates structural gradient priors into deep features and refines alignment through a hybrid matching strategy. Specifically, we introduce the Feature Gradient Enhancer (FGE), which embeds multi-scale, multi-directional gradient filters into the feature space using attention and reconstruction mechanisms to boost feature distinctiveness. Furthermore, we propose the Global-Local Affine-Flow Matcher (GLAM), which combines affine transformation and flow-based refinement within a coarse-to-fine architecture to ensure both structural consistency and local accuracy. Experimental results demonstrate that SOMA significantly improves registration precision, increasing the CMR@1px by 12.29% on the SEN1-2 dataset and 18.50% on the GFGE_SO dataset. In addition, SOMA exhibits strong robustness and generalizes well across diverse scenes and resolutions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5ddb77b5-e9ef-4177-9757-c0e6043fb491Builds on8
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Vision Transformers Need RegistersTimothée Darcet, Maxime Oquab, Julien Mairal, Piotr BojanowskiICLR 2024 · 769 citations
- RFNet: Unsupervised Network for Mutually Reinforcing Multi-modal Image Registration and FusionHan Xu, Jiayi Ma, Jiteng Yuan, Zhuliang Le et al.CVPR 2022 · 161 citations
- Do Computer Vision Foundation Models Learn the Low-level Characteristics of the Human Visual System?Yancheng Cai, Fei Yin, Dounia Hammou, Rafal MantiukCVPR 2025
- OmniGlue: Generalizable Feature Matching with Foundation Model GuidanceHanwen Jiang, Arjun Karpur, Bingyi Cao, Qixing Huang et al.CVPR 2024
Related papers
- CRFT: Consistent-Recurrent Feature Flow Transformer for Cross-Modal Image RegistrationXuecong Liu, Mengzhu Ding, Zixuan Sun, Zhang Li et al.CVPR 2026 · 4 citations
- Deep Algorithm Unrolling with Registration Embedding for PansharpeningTingting Wang, Yongxu Ye, Faming Fang, Guixu Zhang et al.ACM MM 2023 · 8 citations
- Multi-scale Matching Networks for Semantic CorrespondenceDongyang Zhao, Ziyang Song, Zhenghao Ji, Gangming Zhao et al.ICCV 2021 · 56 citations
- GOCor: Bringing Globally Optimized Correspondence Volumes into Your Neural NetworkPrune Truong, Martin Danelljan, Luc Van Gool, Radu TimofteNeurIPS 2020 · 89 citations
- A Stepwise Matching Method for Multi-modal Image based on Cascaded NetworkJinming Mu, Shuiping Gou, Shasha Mao, Shankui ZhengACM MM 2021 · 5 citations
