CausalCtrl: Causality-Aware Control Framework for Text-Guided Visual Editing
Haoxiang Cao, Chaoqun Wang, Yongwen Lai, Shaobo Min, Xuejin Chen
Abstract
Text-guided visual editing aims to modify visual content according to a target prompt while faithfully preserving the structure and identity of the source image or video. However, existing methods ignore confounding effects brought from the pretrained model, i.e., harmful biases learned from the pretraining datasets, leading to spurious correlations during the editing processing. To address this issue, we introduce CausalCtrl, a novel training-free framework that reformulates text-guided visual editing from a causal inference perspective. The core idea is to leverage frontdoor adjustment to estimate the interventional distribution of the output, effectively blocking the influence of hidden confounders introduced by the pretrained model. Specifically, we first design a dual-branch inversion mechanism that disentangles the source content and target semantics into two separate latent embeddings to simplify the sampling space of interventional operation, and perform unbiased denoising through their controlled interaction. Besides, we propose a Structured Attention Injection Module (SAIM) that adaptively identifies and amplifies dominant attention heads using a lightweight SVD-based top-K selection strategy. Extensive experiments on several challenging image and video editing benchmarks demonstrate that CausalCtrl consistently outperforms existing methods in both target semantic alignment and source content preservation, validating the effectiveness of causal intervention in this task.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Cited by top-tier papers2
- Causal-Adapter: Taming Text-to-Image Diffusion for Faithful Counterfactual GenerationLei Tong, Zhihua Liu, Chaochao Lu, Dino Oglic et al.ICML 2026 · 2 citations
- A Style is Worth One Code: Unlocking Code-to-Style Image Generation with Discrete Style SpaceHuijie Liu, Shuhao Cui, Haoxiang Cao, Shuai Ma et al.CVPR 2026 · 1 citation
Related papers
- Causal Attention for Vision-Language TasksXu Yang, Hanwang Zhang, Guojun Qi, Jianfei CaiCVPR 2021
- Visual Representation Learning through Causal Intervention for Controllable Image EditingShanshan Huang, Haoxuan Li, Chunyuan Zheng, Lei Wang et al.CVPR 2025
- Towards Deconfounded Image-Text Matching with Causal InferenceWenhui Li, Xinqi Su, Dan Song, Lanjun Wang et al.ACM MM 2023 · 12 citations
- Counterfactual Image Editing with Disentangled Causal Latent SpaceYushu Pan, Elias BareinboimNeurIPS 2025 · 7 citations
- UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance EditingJianhong Bai, Tianyu He, Yuchi Wang, Junliang Guo et al.ACM MM 2025 · 6 citations
