High-Resolution Daytime Translation Without Domain Labels
Ivan Anokhin, Pavel Solovev, Denis Korzhenkov, Alexey Kharlamov, Taras Khakhulin, Aleksei Silvestrov, Sergey I. Nikolenko, Victor Lempitsky, Gleb Sterkin
Abstract
Modeling daytime changes in high resolution photographs, e.g., re-rendering the same scene under different illuminations typical for day, night, or dawn, is a challenging image manipulation task. We present the high-resolution daytime translation (HiDT) model for this task. HiDT combines a generative image-to-image model and a new upsampling scheme that allows to apply image translation at high resolution. The model demonstrates competitive results in terms of both commonly used GAN metrics and human evaluation. Importantly, this good performance comes as a result of training on a dataset of still landscape images with no daytime labels available. Our results are available at https://saic-mdal.github.io/HiDT/.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 45aa91d1-8121-4d37-8618-bbe2abe68cffCited by top-tier papers17
- Swapping Autoencoder for Deep Image ManipulationTaesung Park, Jun-Yan Zhu, Oliver Wang, Jingwan Lu et al.NeurIPS 2020 · 376 citations
- A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape RepresentationJiteng Mu, Weichao Qiu, Adam Kortylewski, Alan L. Yuille et al.ICCV 2021 · 138 citations
- High-Resolution Image Harmonization via Collaborative Dual TransformationsWenyan Cong, Xinhao Tao, Li Niu, Jing Liang et al.CVPR 2022 · 86 citations
- NightLab: A Dual-level Architecture with Hardness Detection for Segmentation at NightXueqing Deng, Peng Wang, Xiaochen Lian, Shawn D. NewsamCVPR 2022 · 51 citations
- Video Autoencoder: self-supervised disentanglement of static 3D structure and motionZihang Lai, Sifei Liu, Alexei A. Efros, Xiaolong WangICCV 2021 · 37 citations
Builds on2
Related papers
- GlowGAN: Unsupervised Learning of HDR Images from LDR Images in the WildChao Wang, Ana Serrano, Xingang Pan, Bin Chen et al.ICCV 2023 · 29 citations
- High-Resolution Photorealistic Image Translation in Real-Time: A Laplacian Pyramid Translation NetworkJie Liang, Hui Zeng, Lei ZhangCVPR 2021
- EverLight: Indoor-Outdoor Editable HDR Lighting EstimationMohammad Reza Karimi Dastjerdi, Jonathan Eisenmann, Yannick Hold-Geoffroy, Jean-François LalondeICCV 2023 · 41 citations
- Rendering-Aware HDR Environment Map Prediction from a Single ImageJun-Peng Xu, Chenyu Zuo, Fang-Lue Zhang, Miao WangAAAI 2022 · 15 citations
- FlexIT: Towards Flexible Semantic Image TranslationGuillaume Couairon, Asya Grechka, Jakob Verbeek, Holger Schwenk et al.CVPR 2022 · 36 citations
