FlowPortal: Residual-Corrected Flow for Training-Free Video Relighting and Background Replacement
Wenshuo Gao, Junyi Fan, Jiangyue Zeng, Shuai Yang
Abstract
Video relighting with background replacement is a challenging task critical for applications in film production and creative media. Existing methods struggle to balance temporal consistency, spatial fidelity, and illumination naturalness. To address these issues, we introduce FlowPortal, a novel training-free flow-based video relighting framework. Our core innovation is a Residual-Corrected Flow mechanism that transforms a standard flow-based model into an editing model, guaranteeing perfect reconstruction when input conditions are identical and enabling faithful relighting when they differ, resulting in high structural consistency. This is further enhanced by a Decoupled Condition Design for precise lighting control and a High-Frequency Transfer mechanism for detail preservation. Additionally, a masking strategy isolates foreground relighting from background pure generation process. Experiments demonstrate that FlowPortal achieves superior performance in temporal coherence, structural preservation, and lighting realism, while maintaining high efficiency.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b5318209-0d22-488f-bde8-fd3c3fb29ff6Builds on22
- Directly Denoising Diffusion ModelsDan Zhang, Jingjing Wang, Feng LuoICML 2024 · 11,724 citations
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 6,759 citations
- FateZero: Fusing Attentions for Zero-shot Text-based Video EditingChenyang Qi, Xiaodong Cun, Yong Zhang, Chenyang Lei et al.ICCV 2023 · 510 citations
- Prompt-to-Prompt Image Editing with Cross-Attention ControlAmir Hertz, Ron Mokady, Jay Tenenbaum, Kfir Aberman et al.ICLR 2023 · 361 citations
- A Latent Space of Stochastic Diffusion Models for Zero-Shot Image Editing and GuidanceChen Henry Wu, Fernando De la TorreICCV 2023 · 141 citations
Related papers
- AnyPortal: Zero-Shot Consistent Video Background ReplacementWenshuo Gao, Xicheng Lan, Shuai YangICCV 2025
- Light-a-Video: Training-Free Video Relighting via Progressive Light FusionYujie Zhou, Jiazi Bu, Pengyang Ling, Pan Zhang et al.ICCV 2025 · 4 citations
- Neural Video Portrait Relighting in Real-time via Consistency ModelingLongwen Zhang, Qixuan Zhang, Minye Wu, Jingyi Yu et al.ICCV 2021 · 59 citations
- Comprehensive Relighting: Generalizable and Consistent Monocular Human Relighting and HarmonizationJunying Wang, Jingyuan Liu, Xin Sun, Krishna Kumar Singh et al.CVPR 2025
- Pixel Cube: Diffusion-based Portrait Video Relighting Through Realistic Lighting ReproductionYufan Zhang, Yu Ji, Ayo Ajiboye, Rundi Wu et al.SIGGRAPH 2026
