Closed-Form Concept Erasure via Double Projections
Chi Zhang, Jingpu Cheng, Zhixian Wang, Ping Liu
摘要
While modern generative models such as diffusion-based architectures have enabled impressive creative capabilities, they also raise important safety and ethical risks. These concerns have led to growing interest in concept erasure, the process of removing unwanted concepts from model representations. Existing approaches often achieve strong erasure performance but rely on iterative optimization and may inadvertently distort unrelated concepts. In this work, we present a simple yet principled alternative: a linear transformation framework that achieves concept erasure analytically, without any training. Our method adapts a pretrained model through two sequential, closed-form steps: first, computing a proxy projection of the target concept, and second, applying a constrained transformation within the left null space of known concept directions. This design yields a deterministic and geometrically interpretable procedure for safe, efficient, and theory-grounded concept removal. Across a wide range of experiments, including object and style erasure on multiple Stable Diffusion variants and the flow-matching model (FLUX), our approach matches or surpasses the performance of state-of-the-art methods while preserving non-target concepts more faithfully. Requiring only a few seconds to apply, it offers a lightweight and drop-in tool for controlled model editing, advancing the goal of safer and more responsible generative models. Code is available here.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper38
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn 等ICLR 2021 · 被引用 21,477 次
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
相关 Paper
- GEM: Geometric Erasure by Contrastive Velocity Matching in Rectified FlowsJonas Henry Grebe, Tobias Braun, Anna Rohrbach, Marcus RohrbachICML 2026 · 被引用 1 次
- EraseAnything: Enabling Concept Erasure in Rectified Flow TransformersDaiheng Gao, Shilin Lu, Wenbo Zhou, Jiaming Chu 等ICML 2025
- Orthogonal Concept Erasure for Diffusion ModelsYuhao Sun, Lingyun Yu, Hao-Xiang Xu, Fengyuan Miao 等ICML 2026
- Minimalist Concept Erasure in Generative ModelsYang Zhang, Er Jin, Yanfei Dong, Yixuan Wu 等ICML 2025
- ACE: Concept Editing in Diffusion Models without Performance DegradationRuipeng Wang, Junfeng Fang, Jiaqi Li, Hao Chen 等ACM MM 2025
