Video Generation with Stable Transparency via Shiftable RGB-A Distribution Learner
Haotian Dong, Wenjing Wang, Chen Li, Jing LYU, Di Lin
Abstract
Generating RGB-A videos, which include alpha channels for transparency, has wide applications. However, current methods often suffer from low quality due to confusion between RGB and alpha. In this paper, we address this problem by learning shiftable RGB‑A distributions. We adjust both the latent space and noise space, shifting the alpha distribution outward while preserving the RGB distribution, thereby enabling stable transparency generation without compromising RGB quality. Specifically, for the latent space, we propose a transparency‑aware bidirectional diffusion loss during VAE training, which shifts the RGB‑A distribution according to likelihood. For the noise space, we propose shifting the mean of diffusion noise sampling and applying a Gaussian ellipse mask to provide transparency guidance and controllability. Additionally, we construct a high‑quality RGB‑A video dataset. Compared to state‑of‑the‑art methods, our model excels in visual quality, naturalness, transparency rendering, inference convenience, and controllability.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a9b43ce3-abf0-4e44-b13d-dc9946415905Cited by top-tier papers3
- Are Image-to-Video Models Good Zero-Shot Image Editors?Zechuan Zhang, Zhenyuan Chen, Zongxin Yang, Yi YangCVPR 2026 · 4 citations
- LayerT2V: A Unified Multi-Layer Video Generation FrameworkGuangzhao Li, Kangrui Cen, Baixuan Zhao, Yi Xin et al.ICML 2026 · 2 citations
- UniVidX: A Unified Multimodal Framework for Versatile Video Generation via Diffusion PriorsHouyuan Chen, Hong Li, Xianghao Kong, Tianrui Zhu et al.SIGGRAPH 2026
Builds on24
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Scaling Rectified Flow Transformers for High-Resolution Image SynthesisPatrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari et al.ICML 2024 · 3,620 citations
- AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific TuningYuwei Guo, Ceyuan Yang, Anyi Rao, Zhengyang Liang et al.ICLR 2024 · 1,493 citations
- Flow Matching for Generative ModelingYaron Lipman, Ricky T. Q. Chen, Heli Ben-Hamu, Maximilian Nickel et al.ICLR 2023 · 87 citations
Related papers
- Transparent Image Layer Diffusion using Latent TransparencyLvmin Zhang, Maneesh AgrawalaSIGGRAPH 2024 · 42 citations
- ColorDiffuser: Video Colorization with Pretrained Text-to-Image Diffusion ModelsHanyuan Liu, Minshan Xie, Jinbo Xing, Chengze Li et al.ACM MM 2025 · 2 citations
- Trans-Adapter: A Plug-And-Play Framework for Transparent Image InpaintingYuekun Dai, Haitian Li, Shangchen Zhou, Chen Change LoyICCV 2025 · 1 citation
- Enhanced Motion-aware Latent Diffusion Models for Video Frame InterpolationZhilin Huang, Chujun Qin, Yifei Xing, Wenming YangACM MM 2025
- RevealLayer: Disentangling Hidden and Visible Layers via Occlusion-Aware Image DecompositionBinhao Wang, Shihao Zhao, Bo Cheng, Qiuyu Ji et al.ICML 2026
