Personalize Anything for Free with Diffusion Transformer
Haoran Feng, Zehuan Huang, Lin Li, Lu Sheng
Abstract
Personalized image generation aims to produce images of user-specified concepts while enabling flexible editing. Recent training-free approaches, while exhibiting higher computational efficiency than training-based methods, struggle with identity preservation, applicability, and compatibility with diffusion transformers (DiTs). In this paper, we uncover the untapped potential of DiT, where simply replacing denoising tokens with those of a reference subject achieves zero-shot subject reconstruction. This simple yet effective feature injection technique unlocks diverse scenarios, from personalization to image editing. Building upon this observation, we propose Personalize Anything, a training-free framework that achieves personalized image generation in DiT through:1) timestep-adaptive token replacement that enforces subject consistency via early-stage injection and enhances flexibility through late-stage regularization, and 2) patch perturbation strategies to boost structural diversity. Our method seamlessly supports layout-guided generation, multi-subject personalization, and mask-controlled editing. Evaluations demonstrate that our method, without requiring any training, achieves state-of-the-art performance in identity preservation and versatility. Our work establishes new insights into DiTs while delivering a practical paradigm for efficient personalization.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 316c8a0d-893d-4e36-81d8-6f86d4d4d0d6Cited by top-tier papers11
- DiT360: High-Fidelity Panoramic Image Generation via Hybrid TrainingHaoran Feng, Dizhe Zhang, Xiangtai Li, Bo Du et al.CVPR 2026 · 27 citations
- X2Edit: Revisiting Arbitrary-Instruction Image Editing Through Self-Constructed Data and Task-Aware Representation LearningJian Ma, Xujie Zhu, Zihao Pan, Qirong Peng et al.AAAI 2026 · 15 citations
- PairEdit: Learning Semantic Variations for Exemplar-based Image EditingHaoguang Lu, Jiacheng Chen, Zhenguo Yang, Aurele Tohokantche Gnanha et al.NeurIPS 2025 · 8 citations
- PositionIC: Unified Position and Identity Consistency for Image CustomizationJunjie Hu, Tianyang Han, Kai Ma, Jialin Gao et al.CVPR 2026 · 5 citations
- MultiCrafter: High-Fidelity Multi-Subject Generation via Disentangled Attention and Identity-Aware Preference AlignmentTao Wu, Yibo Jiang, Yehao Lu, Zhizhong Wang et al.CVPR 2026 · 4 citations
Builds on33
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
Related papers
- FreeCus: Free Lunch Subject-Driven Customization in Diffusion TransformersYanbing Zhang, Zhe Wang, Qin Zhou, Mengping YangICCV 2025
- Energy-Guided Optimization for Personalized Image Editing with Pretrained Text-to-Image Diffusion ModelsRui Jiang, Xinghe Fu, Guangcong Zheng, Teng Li et al.AAAI 2025 · 2 citations
- W-EDIT: A Wavelet-Based Frequency-Aware Framework for Text-Driven Image EditingJiahui Sun, Weining Wang, Mingzhen Sun, Peiyao Wang et al.ICLR 2026
- Insert Anything: Image Insertion via In-Context Editing in DiTWensong Song, Hong Jiang, Zongxing Yang, Zheqiao Cheng et al.AAAI 2026 · 1 citation
- Teleportraits: Training-Free People Insertion Into Any SceneJialu Gao, K. J. Joseph, Fernando De la TorreICCV 2025
