T-Edit: Triple-Branch Diffusion Anchoring for Consistent Editing
Linsong Shan, Laurence Yang, Zecan Yang, Shijie Lian, lv lv, Qilin Yang
摘要
While Multimodal Diffusion Transformers (MMDiTs) have achieved remarkable success in high-fidelity generation, maintaining semantic faithfulness and structural consistency during the image editing process remains a fundamental challenge. DiT-based editing is primarily limited by cumulative drift and semantic leakage induced by new textual conditions. To address these challenges, we propose T-Edit, a training-free framework that formalizes consistent editing as a trajectory anchoring process. T-Edit explicitly decouples the inversion, reconstruction, and editing trajectories, leveraging the reconstruction branch as a structural reference to achieve real-time compensation for deviations in the latent manifold. To further reveal the internal regulation mechanism of DiTs, we analyze the spatio-temporal heterogeneity of their layer-wise structural sensitivity and accordingly propose a Dynamic Vital Layer (DVL) localization mechanism based on information energy. Furthermore, addressing the asymmetry of textual perturbations in the frequency domain distribution, we introduce a frequency-aware strategy based on tensor Singular Value Decomposition (t-SVD) to anchor (TA) high-rank structural components. Experiments show that T-Edit achieves state-of-the-art performance in both semantic alignment and structural fidelity, and can be seamlessly extended to multi-step editing and video scenarios, providing a new perspective for understanding and controlling the internal stability of DiTs.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper27
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Directly Denoising Diffusion ModelsDan Zhang, Jingjing Wang, Feng LuoICML 2024 · 被引用 11,724 次
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 被引用 5,568 次
相关 Paper
- W-EDIT: A Wavelet-Based Frequency-Aware Framework for Text-Driven Image EditingJiahui Sun, Weining Wang, Mingzhen Sun, Peiyao Wang 等ICLR 2026
- VIVID: Backbone Training-Free Text-to-Image Video Editing via Variational Latent AnchorsZhangkai Wu, Xuhui Fan, Zhongyuan Xie, Kaize Shi 等KDD 2026
- QK-Edit: Revisiting Attention-based Injection in MM-DiT for Image and Video EditingTiancheng Shen, Zilong Huang, Xiangtai Li, Zhijie Lin 等ICCV 2025 · 被引用 2 次
- TweezeEdit: Consistent and Efficient Image Editing with Path RegularizationJianda Mao, Kaibo Wang, Yang Xiang, Kani ChenAAAI 2026 · 被引用 2 次
- ContextFlow: Training-Free Video Object Editing via Adaptive Context EnrichmentYiyang Chen, Xuanhua He, Xiujun Ma, Jack MaAAAI 2026 · 被引用 17 次
