Noise Map Guidance: Inversion with Spatial Context for Real Image Editing
Hansam Cho, Jonghyun Lee, Seoung Bum Kim, Tae-Hyun Oh, Yonghyun Jeong
Abstract
Text-guided diffusion models have become a popular tool in image synthesis, known for producing high-quality and diverse images. However, their application to editing real images often encounters hurdles primarily due to the text condition deteriorating the reconstruction quality and subsequently affecting editing fidelity. Null-text Inversion (NTI) has made strides in this area, but it fails to capture spatial context and requires computationally intensive per-timestep optimization. Addressing these challenges, we present Noise Map Guidance (NMG), an inversion method rich in a spatial context, tailored for real-image editing. Significantly, NMG achieves this without necessitating optimization, yet preserves the editing quality. Our empirical investigations highlight NMG's adaptability across various editing techniques and its robustness to variants of DDIM inversions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8ae12f1d-262c-4d30-ba84-68e59702b0bbCited by top-tier papers14
- Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image EditingHaonan Lin, Yan Chen, Jiahao Wang, Wenbin An et al.NeurIPS 2024 · 46 citations
- BELM: Bidirectional Explicit Linear Multi-step Sampler for Exact Inversion in Diffusion ModelsFangyikang Wang, Hubery Yin, Yuejiang Dong, Huminhao Zhu et al.NeurIPS 2024 · 37 citations
- FastDrag: Manipulate Anything in One StepXuanjia Zhao, Jian Guan, Congyi Fan, Dongli Xu et al.NeurIPS 2024 · 27 citations
- Free Lunch for Stabilizing Rectified Flow InversionChenru Wang, Beier Zhu, Chi ZhangICLR 2026 · 6 citations
- DCI: Dual-Conditional Inversion for Boosting Diffusion-Based Image EditingZixiang Li, Haoyu Wang, Wei Wang, Chuangchuang Tan et al.NeurIPS 2025 · 5 citations
Builds on26
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li et al.NeurIPS 2022 · 8,965 citations
Related papers
- Editable Noise Map Inversion: Encoding Target-image into Noise For High-Fidelity Image ManipulationMingyu Kang, Yong Suk ChoiICML 2025
- Null-text Inversion for Editing Real Images using Guided Diffusion ModelsRon Mokady, Amir Hertz, Kfir Aberman, Yael Pritch et al.CVPR 2023
- Prompt Tuning Inversion for Text-Driven Image Editing Using Diffusion ModelsWenkai Dong, Song Xue, Xiaoyue Duan, Shumin HanICCV 2023 · 104 citations
- Effective Real Image Editing with Accelerated Iterative Diffusion InversionZhihong Pan, Riccardo Gherardi, Xiufeng Xie, Stephen HuangICCV 2023 · 86 citations
- Inversion-Free Image Editing with Language-Guided Diffusion ModelsSihan Xu, Yidong Huang, Jiayi Pan, Ziqiao Ma et al.CVPR 2024 · 12 citations
