MAGREF: Masked Guidance for Any-Reference Video Generation with Subject Disentanglement
Yufan Deng, Yuanyang Yin, Xun Guo, Yizhi Wang, Zhiyuan Fang, Shenghai Yuan, Yiding Yang, Angtian Wang, Bo Liu, Haibin Huang, Chongyang Ma
摘要
We tackle the task of any-reference video generation, which aims to synthesize videos conditioned on arbitrary types and combinations of reference subjects, together with textual prompts. This task faces persistent challenges, including identity inconsistency, entanglement among multiple reference subjects, and copy-paste artifacts. To address these issues, we introduce MAGREF, a unified and effective framework for any-reference video generation. Our approach incorporates masked guidance and a subject disentanglement mechanism, enabling flexible synthesis conditioned on diverse reference images and textual prompts. Specifically, masked guidance employs a region-aware masking mechanism combined with pixel-wise channel concatenation to preserve appearance features of multiple subjects along the channel dimension. This design preserves identity consistency and maintains the capabilities of the pre-trained backbone, without requiring any architectural changes. To mitigate subject confusion, we introduce a subject disentanglement mechanism which injects the semantic values of each subject derived from the text condition into its corresponding visual region. Additionally, we establish a four-stage data pipeline to construct diverse training pairs, effectively alleviating copy-paste artifacts. Extensive experiments on a comprehensive benchmark demonstrate that MAGREF consistently outperforms existing state-of-the-art approaches, paving the way for scalable, controllable, and high-fidelity any-reference video synthesis. The code and video demos are available in the supplementary materials.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper8
- Scaling Zero-Shot Reference-to-Video GenerationZijian Zhou, Shikun Liu, Haozhe Liu, Haonan Qiu 等CVPR 2026 · 被引用 10 次
- Lynx: Towards High-Fidelity Personalized Video GenerationShen Sang, Tiancheng Zhi, Tianpei Gu, Jing Liu 等CVPR 2026 · 被引用 9 次
- TS-Attn: Temporal-wise Separable Attention for Multi-Event Video GenerationHongyu Zhang, Yufan Deng, Zilin Pan, Peng-Tao Jiang 等ICLR 2026 · 被引用 5 次
- AlcheMinT: Fine-grained Temporal Control for Multi-Reference Consistent Video GenerationSharath Girish, Viacheslav Ivanov, Tsai-Shien Chen, Hao Chen 等CVPR 2026 · 被引用 4 次
- MV-S2V: Multi-View Subject-Consistent Video GenerationZiyang Song, Xinyu Gong, Bangya Liu, Zelin ZhaoSIGGRAPH 2026 · 被引用 1 次
它引用的顶会 Paper27
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 被引用 11,349 次
- BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsJunnan Li, Dongxu Li, Silvio Savarese, Steven C. H. HoiICML 2023 · 被引用 7,873 次
相关 Paper
- DreamSwapV: Mask-guided Subject Swapping for Any Customized Video EditingWeitao Wang, Zichen Wang, Hongdeng Shen, Yulei Lu 等ICLR 2026 · 被引用 1 次
- AnyID: Ultra-Fidelity Universal Identity-Preserving Video Generation from Any Visual ReferencesJiahao Wang, Hualian Sheng, Sijia Cai, Yuxiao Yang 等CVPR 2026 · 被引用 1 次
- MoFu: Scale-Aware Modulation and Fourier Fusion for Multi-Subject Video GenerationRun Ling, Ke Cao, Jian Lu, Ao Ma 等AAAI 2026 · 被引用 4 次
- Movie Weaver: Tuning-Free Multi-Concept Video Personalization with Anchored PromptsFeng Liang, Haoyu Ma, Zecheng He, Tingbo Hou 等CVPR 2025
- Phantom: Subject-Consistent Video Generation via Cross-Modal AlignmentLijie Liu, Tianxiang Ma, Bingchuan Li, Zhuowei Chen 等ICCV 2025 · 被引用 128 次
