Precise, Fast, and Low-cost Concept Erasure in Value Space: Orthogonal Complement Matters

Single-Concept Erasure Multi-Concept Erasure Original Image (a) Erasure Efficacy and Prior Preservation (b) Transferability Figure 1. The proposed Adaptive Value Decomposer (AdaVD) demonstrates a satisfactory balance between erasure efficacy and prior preservation and an effective transferability across T2I diffusion models. (a) Compared to SLD [39], AdaVD enables precise concept erasure without compromising prior knowledge for non-target concepts at both single-and multi-concept erasure. This is facilitated by a precise disentanglement of target semantics (e.g., "Snoopy") and a robust preservation of non-target ones (e.g., "Teddy"), with visualization interpretation marked by . (b) AdaVD can be transferred to various T2I models, e.g., SDXL [31], DreamShaper [6], Chilloutmix [5].