Bridging Day and Night: Target-Class Hallucination Suppression in Unpaired Image Translation
Shuwei Li, Lei Tan, Robby T. Tan
Abstract
Day-to-night unpaired image translation is important to downstream tasks but remains challenging due to large appearance shifts and the lack of direct pixel-level supervision. Existing methods often introduce semantic hallucinations, where objects from target classes such as traffic signs and vehicles, as well as man-made light effects, are incorrectly synthesized. These hallucinations significantly degrade downstream performance. We propose a novel framework that detects and suppresses hallucinations of target-class features during unpaired translation. To detect hallucination, we design a dual-head discriminator that additionally performs semantic segmentation to identify hallucinated content in background regions. To suppress these hallucinations, we introduce class-specific prototypes, constructed by aggregating features of annotated target-domain objects, which act as semantic anchors for each class. Built upon a Schrödinger Bridge-based translation model, our framework performs iterative refinement, where detected hallucination features are explicitly pushed away from class prototypes in feature space, thus preserving object semantics across the translation trajectory. Experiments show that our method outperforms existing approaches both qualitatively and quantitatively. On the BDD100K dataset, it improves mAP by 15.5% for dayto-night domain adaptation, with a notable 31.7% gain for classes such as traffic lights that are prone to hallucinations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0103b55d-e0d3-4f9a-addd-d1b972effebcCited by top-tier papers2
- LaS-Comp: Zero-shot 3D Completion with Latent–Spatial ConsistencyWeilong Yan, Li Haipeng, Hao Xu, Nianjin Ye et al.CVPR 2026 · 14 citations
- FUSE: Frequency-domain Unification and Spectral Energy Alignment for Multi-modal Object Re-IdentificationXuanhao Qi, Tom Luan, Yukang Zhang, Jinkai Zheng et al.ICML 2026
Builds on15
- SDEdit: Guided Image Synthesis and Editing with Stochastic Differential EquationsChenlin Meng, Yutong He, Yang Song, Jiaming Song et al.ICLR 2022 · 2,128 citations
- Hiera: A Hierarchical Vision Transformer without the Bells-and-WhistlesChaitanya Ryali, Yuan-Ting Hu, Daniel Bolya, Chen Wei et al.ICML 2023 · 388 citations
- Zero-shot Image-to-Image TranslationGaurav Parmar, Krishna Kumar Singh, Richard Zhang, Yijun Li et al.SIGGRAPH 2023 · 355 citations
- A Latent Space of Stochastic Diffusion Models for Zero-Shot Image Editing and GuidanceChen Henry Wu, Fernando De la TorreICCV 2023 · 141 citations
- InstaFormer: Instance-Aware Image-to-Image Translation with TransformerSoohyun Kim, Jongbeom Baek, Jihye Park, Gyeongnyeon Kim et al.CVPR 2022 · 53 citations
Related papers
- DLDA: Unified Dual-Level Domain Adaptation for Low-Light Object DetectionJiayi Hu, Qian Zhao, Gang LiAAAI 2026
- A Style-aware Discriminator for Controllable Image TranslationKunhee Kim, Sanghun Park, Eunyeong Jeon, Taehun Kim et al.CVPR 2022 · 31 citations
- Unpaired Image-to-Image Translation via Neural Schrödinger BridgeBeomsu Kim, Gihyun Kwon, Kwanyoung Kim, Jong Chul YeICLR 2024 · 131 citations
- BAPA-Net: Boundary Adaptation and Prototype Alignment for Cross-domain Semantic SegmentationYahao Liu, Jinhong Deng, Xinchen Gao, Wen Li et al.ICCV 2021 · 91 citations
- DUNIT: Detection-Based Unsupervised Image-to-Image TranslationDeblina Bhattacharjee, Seungryong Kim, Guillaume Vizier, Mathieu SalzmannCVPR 2020
