Structure-Aware Riemannian Flow Matching for Registration and Fusion of Hyperspectral and Multispectral Images
Quan Zhang, Jun Li, Weilong Zhu, MINGYANG LI, Qinmu Shen, Yuanxi Peng
Abstract
Precise alignment is a prerequisite for hyperspectral and multispectral image fusion, yet existing methods struggle with complex non-rigid deformations. Existing techniques either suffer from inter-task error accumulation by treating registration and fusion as disjoint processes or neglect the geometric nature of distortions by relying on isotropic Euclidean metrics. We propose Structure-Aware Riemannian Flow Matching (SA-RFM), a geometry-informed framework for joint registration and fusion of hyperspectral and multispectral images. SA-RFM reformulates registration as dynamic optimal transport on a structure-induced Riemannian manifold, where anisotropic costs are derived from MSI structural cues. To circumvent the complexity of explicit OT solvers, we incorporate this geometry into a conditional flow matching framework via a local cost approximation. This formulation is realized through two synergistic mechanisms: a Riemannian Flow Matching objective that enforces structure-aware error measurement, and an optimal transport direction regularization that aligns the velocity field with the induced metric, thereby resolving the fundamental mismatch between anisotropic costs and conventional Euclidean supervision. Extensive experiments on four datasets demonstrate the superiority of our method. Code is available at: https://github.com/ZhangQuan-hub.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6e8bf73a-13d4-42b5-835e-5c40d9d80f1fBuilds on9
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Directly Denoising Diffusion ModelsDan Zhang, Jingjing Wang, Feng LuoICML 2024 · 11,724 citations
- Consistency ModelsYang Song, Prafulla Dhariwal, Mark Chen, Ilya SutskeverICML 2023 · 1,720 citations
- Flow Matching for Generative ModelingYaron Lipman, Ricky T. Q. Chen, Heli Ben-Hamu, Maximilian Nickel et al.ICLR 2023 · 87 citations
Related papers
- Geometry-Aware Image Flow MatchingJunho Lee, Kwanseok Kim, Joonseok LeeICML 2026 · 3 citations
- RFMPose: Generative Category-level Object Pose Estimation via Riemannian Flow MatchingWenzhe Ouyang, Qi Ye, Jinghua Wang, Zenglin Xu et al.NeurIPS 2025 · 5 citations
- Riemannian Variational Flow Matching for Material and Protein DesignOlga Zaghen, Floor Eijkelboom, Alison Pouplin, Cong Liu et al.ICLR 2026 · 10 citations
- Metric Flow Matching for Smooth Interpolations on the Data ManifoldKacper Kapusniak, Peter Potaptchik, Teodora Reu, Leo Zhang et al.NeurIPS 2024 · 89 citations
- Categorical Flow Matching on Statistical ManifoldsChaoran Cheng, Jiahan Li, Jian Peng, Ge LiuNeurIPS 2024 · 48 citations
