MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformers
Yuechen Zhang, Yaoyang Liu, Bin Xia, Bohao Peng, Zexin Yan, Eric Lo, Jiaya Jia
摘要
We present MagicMirror, a framework for generating identity-preserved videos with cinematic-level quality and dynamic motion. While recent advances in video diffusion models have shown impressive capabilities in text-to-video generation, maintaining consistent identity while producing natural motion remains challenging. Previous methods either require person-specific fine-tuning or struggle to balance identity preservation with motion diversity. Built upon Video Diffusion Transformers, our method introduces three key components: (1) a dual-branch facial feature extractor that captures both identity and structural features, (2) a lightweight cross-modal adapter with Conditioned Adaptive Normalization for efficient identity integration, and (3) a two-stage training strategy combining synthetic identity pairs with video data. Extensive experiments demonstrate that MagicMirror effectively balances identity consistency with natural motion, outperforming existing methods across multiple metrics while requiring minimal parameters added. The code and model will be made publicly available.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper10
- VACE: All-in-One Video Creation and EditingZeyinzi Jiang, Zhen Han, Chaojie Mao, Jingfeng Zhang 等ICCV 2025 · 被引用 58 次
- Unified In-Context Video EditingZixuan Ye, Xuanhua He, Quande Liu, Qiulin Wang 等ICLR 2026 · 被引用 37 次
- Training-Free Efficient Video Generation via Dynamic Token CarvingYuechen Zhang, Jinbo Xing, Bin Xia, Shaoteng Liu 等NeurIPS 2025 · 被引用 37 次
- LumosX: Relate Any Identities with Their Attributes for Personalized Video GenerationJiazheng Xing, Fei Du, Hangjie Yuan, Pengwei Liu 等ICLR 2026 · 被引用 6 次
- FullDiT: Video Generative Foundation Models with Multimodal Control via Full AttentionXuan Ju, Weicai Ye, Quande Liu, Qiulin Wang 等ICCV 2025 · 被引用 5 次
它引用的顶会 Paper38
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn 等ICLR 2021 · 被引用 21,477 次
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 被引用 13,211 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
相关 Paper
- ExpPortrait: Expressive Portrait Generation via Personalized RepresentationJunyi Wang, Yudong Guo, Boyang Guo, Shengming Yang 等CVPR 2026
- Frame In-N-Out: Unbounded Controllable Image-to-Video GenerationBoyang Wang, Xuweiyi Chen, Matheus Gadelha, Zezhou ChengNeurIPS 2025 · 被引用 9 次
- LaVieID: Local Autoregressive Diffusion Transformers for Identity-Preserving Video CreationWenhui Song, Hanhui Li, Jiehui Huang, Panwen Hu 等ACM MM 2025
- Lynx: Towards High-Fidelity Personalized Video GenerationShen Sang, Tiancheng Zhi, Tianpei Gu, Jing Liu 等CVPR 2026 · 被引用 9 次
- Identity-Preserving Text-to-Video Generation by Frequency DecompositionShenghai Yuan, Jinfa Huang, Xianyi He, Yunyang Ge 等CVPR 2025
