Adaptive Domain Shift in Diffusion Models for Cross-Modality Image Translation
Zihao Wang, Yuzhou Chen, Shaogang Ren
Abstract
Cross-modal image translation remains brittle and inefficient. Standard diffusion approaches often rely on a single, global linear transfer between domains. We find that this shortcut forces the sampler to traverse off-manifold, high-cost regions, inflating the correction burden and inviting semantic drift. We refer to this shared failure mode as fixed-schedule domain transfer. In this paper, we embed domain-shift dynamics directly into the generative process. Our model predicts a spatially varying mixing field at every reverse step and injects an explicit, target-consistent restoration term into the drift. This in-step guidance keeps large updates on-manifold and shifts the model’s role from global alignment to local residual correction. We provide a continuous-time formulation with an exact solution form and derive a practical first-order sampler that preserves marginal consistency. Empirically, across translation tasks in medical imaging, remote sensing, and electroluminescence semantic mapping, our framework improves structural fidelity and semantic consistency while converging in fewer denoising steps. The source code is in https://github.com/LaplaceLab/CDTSDE.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a15bedc1-4ce5-4398-8255-655075e8415dBuilds on17
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- SDEdit: Guided Image Synthesis and Editing with Stochastic Differential EquationsChenlin Meng, Yutong He, Yang Song, Jiaming Song et al.ICLR 2022 · 2,128 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- ILVR: Conditioning Method for Denoising Diffusion Probabilistic ModelsJooyoung Choi, Sungwon Kim, Yonghyun Jeong, Youngjune Gwon et al.ICCV 2021 · 933 citations
Related papers
- Diffusion-based Image Translation with Label Guidance for Domain Adaptive Semantic SegmentationDuo Peng, Ping Hu, Qiuhong Ke, Jun LiuICCV 2023 · 42 citations
- Decoupled Residual Denoising Diffusion Models for Unified and Data Efficient Image-to-Image TranslationZiyue Lin, Jiahe Hou, Hongyu Xia, Xinrui Xie et al.CVPR 2026 · 4 citations
- Rethinking Diffusion Bridge Model with Dual Alignments for Medical Image SynthesisJinbao Wei, Yuhang Chen, Zhijie Wang, Gang Yang et al.ACM MM 2025 · 3 citations
- SGCD: Stain-Guided CycleDiffusion for Unsupervised Domain Adaptation of Histopathology Image ClassificationHsi-Ling Chen, Chun-Shien Lu, Pau-Choo ChungNeurIPS 2025 · 1 citation
- MIDMs: Matching Interleaved Diffusion Models for Exemplar-Based Image TranslationJunyoung Seo, Gyuseong Lee, Seokju Cho, Jiyoung Lee et al.AAAI 2023 · 32 citations
