Unsupervised Image-to-Image Translation with Density Changing Regularization
Shaoan Xie, Qirong Ho, Kun Zhang
Abstract
Unpaired image-to-image translation aims to translate an input image to another domain such that the output image looks like an image from another domain while important semantic information are preserved. Inferring the optimal mapping with unpaired data is impossible without making any assumptions. In this paper, we make a density changing assumption where image patches of high probability density should be mapped to patches of high probability density in another domain. Then we propose an efficient way to enforce this assumption: we train the flows as density estimators and penalize the variance of density changes. Despite its simplicity, our method achieves the best performance on benchmark datasets and needs only 56 -86% of training time of the existing state-of-the-art method. The training and evaluation code are avaliable at https://github.com/Mid-Push/ Decent.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers4
- StegoGAN: Leveraging Steganography for Non-Bijective Image-to-Image TranslationSidi Wu, Yizi Chen, Samuel Mermet, Lorenz Hurni et al.CVPR 2024 · 32 citations
- Towards Identifiable Unsupervised Domain Translation: A Diversified Distribution Matching ApproachSagar Shrestha, Xiao FuICLR 2024 · 6 citations
- Unsupervised Disentanglement of Content and Style via Variance-Invariance ConstraintsYuxuan Wu, Ziyu Wang, Bhiksha Raj, Gus XiaICLR 2025
- Unpaired Image-to-Image Translation with Shortest Path RegularizationShaoan Xie, Yanwu Xu, Mingming Gong, Kun ZhangCVPR 2023
Builds on14
- U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image TranslationJunho Kim, Minjae Kim, Hyeonwoo Kang, Kwanghee LeeICLR 2020 · 632 citations
- Rethinking the Truly Unsupervised Image-to-Image TranslationKyungjune Baek, Yunjey Choi, Youngjung Uh, Jaejun Yoo et al.ICCV 2021 · 115 citations
- Exploring Patch-wise Semantic Relation for Contrastive Learning in Image-to-Image Translation TasksChanyong Jung, Gihyun Kwon, Jong Chul YeCVPR 2022 · 103 citations
- QS-Attn: Query-Selected Attention for Contrastive Learning in I2I TranslationXueqi Hu, Xinyue Zhou, Qiusheng Huang, Zhengyi Shi et al.CVPR 2022 · 103 citations
- Instance-wise Hard Negative Example Generation for Contrastive Learning in Unpaired Image-to-Image TranslationWeilun Wang, Wengang Zhou, Jianmin Bao, Dong Chen et al.ICCV 2021 · 100 citations
Related papers
- Semantically Robust Unpaired Image Translation for Data with Unmatched Semantics StatisticsZhiwei Jia, Bodi Yuan, Kangkang Wang, Hong Wu et al.ICCV 2021 · 26 citations
- Attribute-Driven Spontaneous Motion in Unpaired Image TranslationRuizheng Wu, Xin Tao, Xiaodong Gu, Xiaoyong Shen et al.ICCV 2019 · 18 citations
- Benign Examples: Imperceptible Changes Can Enhance Image Translation PerformanceVignesh Srinivasan, Klaus-Robert Müller, Wojciech Samek, Shinichi NakajimaAAAI 2020 · 2 citations
- Self-Supervised Dense Consistency Regularization for Image-to-Image TranslationMinsu Ko, Eunju Cha, Sungjoo Suh, Huijin Lee et al.CVPR 2022 · 25 citations
- DUNIT: Detection-Based Unsupervised Image-to-Image TranslationDeblina Bhattacharjee, Seungryong Kim, Guillaume Vizier, Mathieu SalzmannCVPR 2020
