Semantic Image Inversion and Editing using Rectified Stochastic Differential Equations
Litu Rout, Yujia Chen, Nataniel Ruiz, Constantine Caramanis, Sanjay Shakkottai, Wen-Sheng Chu
摘要
Generative models transform random noise into images; their inversion aims to transform images back to structured noise for recovery and editing. This paper addresses two key tasks: (i) inversion and (ii) editing of a real image using stochastic equivalents of rectified flow models (such as Flux). Although Diffusion Models (DMs) have recently dominated the field of generative modeling for images, their inversion presents faithfulness and editability challenges due to nonlinearities in drift and diffusion. Existing state-of-the-art DM inversion approaches rely on training of additional parameters or test-time optimization of latent variables; both are expensive in practice. Rectified Flows (RFs) offer a promising alternative to diffusion models, yet their inversion has been underexplored. We propose RF inversion using dynamic optimal control derived via a linear quadratic regulator. We prove that the resulting vector field is equivalent to a rectified stochastic differential equation. Additionally, we extend our framework to design a stochastic sampler for Flux. Our inversion method allows for state-of-the-art performance in zero-shot inversion and editing, outperforming prior works in stroke-to-image synthesis and semantic image editing, with large-scale human evaluations confirming user preference.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper89
- UniEdit-Flow: Unleashing Inversion and Editing in the Era of Flow ModelsGuanlong Jiao, Biqing Huang, Kuan-Chieh Wang, Renjie LiaoICLR 2026 · 被引用 42 次
- FlowAlign: Trajectory-Regularized, Inversion-Free Flow-based Image EditingJeongsol Kim, Yeobin Hong, Jonghyun Park, Jong Chul YeICLR 2026 · 被引用 35 次
- OminiControl: Minimal and Universal Control for Diffusion TransformerZhenxiong Tan, Songhua Liu, Xingyi Yang, Qiaochu Xue 等ICCV 2025 · 被引用 34 次
- DragFlow: Unleashing DiT Priors with Region-Based Supervision for Drag EditingZihan Zhou, Shilin Lu, Shuli Leng, Shaocong Zhang 等ICLR 2026 · 被引用 33 次
- Flowedit: Inversion-Free Text-Based Editing Using Pre-Trained Flow ModelsVladimir Kulikov, Matan Kleiner, Inbar Huberman-Spiegelglas, Tomer MichaeliICCV 2025 · 被引用 30 次
它引用的顶会 Paper34
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
相关 Paper
- FlowChef: Steering of Rectified Flow Models for Controlled GenerationsMaitreya Patel, Song Wen, Dimitris N. Metaxas, Yezhou YangICCV 2025 · 被引用 2 次
- Text-to-Image Rectified Flow as Plug-and-Play PriorsXiaofeng Yang, Cheng Chen, Xulei Yang, Fayao Liu 等ICLR 2025
- Taming Rectified Flow for Inversion and EditingJiangshan Wang, Junfu Pu, Zhongang Qi, Jiayi Guo 等ICML 2025
- Lightning-Fast Image Inversion and Editing for Text-to-Image Diffusion ModelsDvir Samuel, Barak Meiri, Haggai Maron, Yoad Tewel 等ICLR 2025
- Delta Rectified Flow Sampling for Text-to-Image EditingGaspard Beaudouin, Minghan Li, Jaeyeon Kim, Sung-Hoon Yoon 等CVPR 2026 · 被引用 4 次
