Where Concept Erasure Should Occur: Concept–Layer Alignment in Text-to-Video Diffusion Models
Yiwei Xie, Ping Liu, Zheng Zhang
Abstract
Text-to-video diffusion transformers encode semantic information unevenly across model depth, which constrains effective concept erasure. We identify a representational bottleneck, termed concept–layer topological alignment, under which target concepts exhibit higher separability at certain representational depths. Outside these depths, concept and non-target signals remain strongly entangled, limiting the effectiveness of depth-specific erasure. This observation reframes concept erasure as the problem of identifying representational depths where concept–non-target separation naturally emerges. Motivated by this structural constraint, we introduce CLEAR, a separability-driven optimization framework for concept erasure that explicitly enforces concept–layer alignment. CLEAR operationalizes this principle by formulating layer selection as an optimization problem over concept–non-target separability, rather than relying on layer-agnostic or heuristic choices. To enable this, we introduce a separability-aware objective that favors layers exhibiting stronger concept–non-target separation. Experiments on large-scale text-to-video diffusion models demonstrate that enforcing concept--layer alignment leads to more precise concept suppression while preserving overall generative quality.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 326afa24-4989-45e9-a37b-39f84dab48c8Builds on24
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li et al.NeurIPS 2022 · 8,965 citations
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
- Video Diffusion ModelsJonathan Ho, Tim Salimans, Alexey A. Gritsenko, William Chan et al.NeurIPS 2022 · 2,948 citations
- Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video GenerationJay Zhangjie Wu, Yixiao Ge, Xintao Wang, Stan Weixian Lei et al.ICCV 2023 · 1,113 citations
Related papers
- SDErasure: Concept-Specific Trajectory Shifting for Concept Erasure via Adaptive Diffusion ClassifierFengyuan Miao, Shancheng Fang, Lingyun Yu, Yadong Qu et al.ICLR 2026
- Orthogonal Concept Erasure for Diffusion ModelsYuhao Sun, Lingyun Yu, Hao-Xiang Xu, Fengyuan Miao et al.ICML 2026
- MapRoute:Precise-Concept Erasing Mappers via Semantic RoutingSihao Li, Baixi Baixi, Shuohong Xia, Yunyun YangCVPR 2026
- Fantastic Targets for Concept Erasure in Diffusion Models and Where To Find ThemAnh Tuan Bui, Thuy-Trang Vu, Long Tung Vuong, Trung Le et al.ICLR 2025
- Localized Concept Erasure in Text-to-Image Diffusion Models via High-Level Representation MisdirectionUichan Lee, Jeonghyeon Kim, Sangheum HwangICLR 2026 · 3 citations
