RegionE: Adaptive Region-Aware Generation for Efficient Image Editing
Pengtao Chen, Xianfang Zeng, Maosen Zhao, Mingzhu Shen, Peng Ye, Bangyin Xiang, Zhibo Wang, Wei Cheng, Gang Yu, Tao Chen
摘要
Recently, instruction-based image editing (IIE) has received widespread attention. In practice, IIE often modifies only specific regions of an image, while the remaining areas largely remain unchanged. Although these two types of regions differ significantly in generation difficulty and computational redundancy, existing IIE models do not account for this distinction, instead applying a uniform generation process across the entire image. This motivates us to propose RegionE, an adaptive, region-aware generation framework that accelerates IIE tasks without additional training. Specifically, the RegionE framework consists of three main components: 1) Adaptive Region Partition. We observed that the trajectory of unedited regions is straight, allowing for multi-step denoised predictions to be inferred in a single step. Therefore, in the early denoising stages, we partition the image into edited and unedited regions based on the difference between the final estimated result and the reference image. 2) Region-Aware Generation. After distinguishing the regions, we replace multi-step denoising with one-step prediction for unedited areas. For edited regions, the trajectory is curved, requiring local iterative denoising. To improve the efficiency and quality of local iterative generation, we propose the Region-Instruction KV Cache, which reduces computational cost while incorporating global information. 3) Adaptive Velocity Decay Cache. Observing that adjacent timesteps in edited regions exhibit strong velocity similarity, we further propose an adaptive velocity decay cache to accelerate the local denoising process. We applied RegionE to state-of-the-art IIE base models, including Step1X-Edit, FLUX.1 Kontext, and Qwen-Image-Edit. RegionE achieved acceleration factors of 2.57×, 2.41×, and 2.06×, respectively, with minimal quality loss (PSNR: 30.520–32.133). Evaluations by GPT-4o also confirmed that semantic and perceptual fidelity were well preserved.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- SpotEdit: Selective Region Editing in Diffusion TransformersZhibin Qin, Zhenxiong Tan, Zeqing Wang, Songhua Liu 等CVPR 2026 · 被引用 7 次
- CacheEdit: Efficient Multi-round Image Editing via Adaptive Token-wise Reuse.Jinxin Yu, Xueqing Chen, Yudong Pan, Lian Liu 等ICML 2026
它引用的顶会 Paper25
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 被引用 6,759 次
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 被引用 5,568 次
- Structural Pruning for Diffusion ModelsGongfan Fang, Xinyin Ma, Xinchao WangNeurIPS 2023 · 被引用 257 次
- DiTFastAttn: Attention Compression for Diffusion Transformer ModelsZhihang Yuan, Hanling Zhang, Lu Pu, Xuefei Ning 等NeurIPS 2024 · 被引用 134 次
相关 Paper
- EEdit ⚡: Rethinking the Spatial and Temporal Redundancy for Efficient Image EditingZexuan Yan, Yue Ma, Chang Zou, Wenteng Chen 等ICCV 2025 · 被引用 5 次
- HierEdit: Region-Aware Hierarchical Diffusion for Efficient High-Resolution EditingYuyao Zhang, Alexander Huang-Menders, Yu-Wing TaiCVPR 2026 · 被引用 2 次
- FireEdit: Fine-grained Instruction-based Image Editing via Region-aware Vision Language ModelJun Zhou, Jiahao Li, Zunnan Xu, Hanhui Li 等CVPR 2025
- Shifting the Breaking Point of Flow Matching for Multi-Instance EditingCarmine Zaccagnino, Fabio Quattrini, Enis Simsar, Marta Gazulla 等ICML 2026 · 被引用 1 次
- Focus Where It Matters: LLM-Guided Regional Identification for Instruction-based Image EditingMinho Park, Youngjoo Jo, Jae-Hyeok Lee, Jiyong Lee 等ACM MM 2025
