LightningDrag: Lightning Fast and Accurate Drag-based Image Editing Emerging from Videos
Yujun Shi, Jun Hao Liew, Hanshu Yan, Vincent Y. F. Tan, Jiashi Feng
摘要
Accuracy and speed are critical in image editing tasks. Pan et al. introduced a drag-based framework using Generative Adversarial Networks, and subsequent studies have leveraged large-scale diffusion models. However, these methods often require over a minute per edit and exhibit low success rates. We present LIGHT-NINGDRAG, which achieves high-quality dragbased editing in about one second on general images. By redefining drag-based editing as a conditional generation task, we eliminate the need for time-consuming latent optimization or gradient-based guidance, achieving high-quality editing in <1s. Our model is trained on largescale paired video frames, capturing diverse motion (object translations, pose shifts, zooming, etc.) to significantly improve accuracy and consistency. Despite being trained only on videos, our model generalizes to local deformations beyond the training data (e.g., lengthening hair, twisting rainbows). Extensive evaluations confirm the superiority of our approach. The code and model are available at https://github.com/magicresearch/LightningDrag .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper5
- FramePainter: Endowing Interactive Image Editing with Video Diffusion PriorsYabo Zhang, Xinpeng Zhou, Yihan Zeng, Hang Xu 等ICCV 2025 · 被引用 3 次
- Geometric Image Editing via Effects-Sensitive In-Context Inpainting with Diffusion TransformersShuo Zhang, Wenzhuo Wu, Huayu Zhang, Jiarong Cheng 等ICLR 2026 · 被引用 1 次
- MR. Illuminate: Zero-Shot Low-Light Image Enhancement with Diffusion PriorJoshua Cho, Sara Aghajanzadeh, Zhen Zhu, David ForsythCVPR 2026
- CLIPDrag: Combining Text-based and Drag-based Instructions for Image EditingZiqi Jiang, Zhen Wang, Long ChenICLR 2025
- Motion Modes: What Could Happen Next?Karran Pandey, Yannick Hold-Geoffroy, Matheus Gadelha, Niloy J. Mitra 等CVPR 2025
它引用的顶会 Paper31
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li 等NeurIPS 2022 · 被引用 8,965 次
相关 Paper
- FastDrag: Manipulate Anything in One StepXuanjia Zhao, Jian Guan, Congyi Fan, Dongli Xu 等NeurIPS 2024 · 被引用 27 次
- DragDiffusion: Harnessing Diffusion Models for Interactive Point-Based Image EditingYujun Shi, Chuhui Xue, Jun Hao Liew, Jiachun Pan 等CVPR 2024 · 被引用 117 次
- DragonDiffusion: Enabling Drag-style Manipulation on Diffusion ModelsChong Mou, Xintao Wang, Jiechong Song, Ying Shan 等ICLR 2024 · 被引用 223 次
- DiffEditor: Boosting Accuracy and Flexibility on Diffusion-Based Image EditingChong Mou, Xintao Wang, Jiechong Song, Ying Shan 等CVPR 2024 · 被引用 36 次
- LazyDrag: Enabling Stable Drag-Based Editing on Multi-Modal Diffusion Transformers via Explicit CorrespondenceZixin Yin, Xili Dai, Duomin Wang, Xianfang Zeng 等ICLR 2026 · 被引用 4 次
