PureCC: Pure Learning for Text-to-Image Concept Customization
Zhichao Liao, Xiaole Xian, Qingyu Li, Wenyu Qin, Meng Wang, Weicheng Xie, Siyang Song, Pingfa Feng, Long ZENG, Liang Pan
Abstract
Existing concept customization methods have achieved remarkable outcomes in high-fidelity and multi-concept customization.However, they often neglect the influence on the original model's behavior and capabilities when learning new personalized concepts.To address this issue, we propose PureCC. PureCC novelly introduces a decoupled learning objective for concept customization, which combines the implicit guidance of the target concept with the original conditional prediction. This separated form enables PureCC to substantially focus on the original model during training. Moreover, based on this objective, PureCC designs a dual-branch training pipeline that includes a frozen extractor providing purified target concept representation as implicit guidance and a trainable flow model producing the original conditional prediction, jointly achieving pure learning for personalized concept. Furthermore, PureCC introduces an novel adaptive guidance scale to dynamically adjust the guidance strength of the target concept, balancing between customization fidelity and model preservation. Extensive experiments show that PureCC achieves state-of-the-art performance in preserving the original behavior and capabilities while enabling high-fidelity concept customization.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 226e7bb5-c114-44ed-bf02-c9fc68d3138fBuilds on36
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao et al.ICCV 2023 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
Related papers
- DCoAR: Deep Concept Injection into Unified Autoregressive Models for Personalized Text-to-Image GenerationFangtai Wu, Mushui Liu, Weijie He, Zhao Wang et al.CVPR 2026 · 1 citation
- Concept Conductor: Orchestrating Multiple Personalized Concepts in Text-to-Image SynthesisZebin Yao, Fangxiang Feng, Ruifan Li, Xiaojie WangAAAI 2025 · 3 citations
- ClassDiffusion: More Aligned Personalization Tuning with Explicit Class GuidanceJiannan Huang, Jun Hao Liew, Hanshu Yan, Yuyang Yin et al.ICLR 2025 · 1 citation
- Orthogonal Adaptation for Modular Customization of Diffusion ModelsRyan Po, Guandao Yang, Kfir Aberman, Gordon WetzsteinCVPR 2024 · 18 citations
- Personalized Residuals for Concept-Driven Text-to-Image GenerationCusuh Ham, Matthew Fisher, James Hays, Nicholas I. Kolkin et al.CVPR 2024
