PrevizWhiz: Combining Rough 3D Scenes and 2D Video to Guide Generative Video Previsualization
Erzhen Hu, Frederik Brudy, David Ledo, George W. Fitzmaurice, Fraser Anderson
摘要
In pre-production, filmmakers and 3D animation experts must rapidly prototype ideas to explore a film’s possibilities before full-scale production, yet conventional approaches involve trade-offs in efficiency and expressiveness. Hand-drawn storyboards often lack spatial precision needed for complex cinematography, while 3D previsualization demands expertise and high-quality rigged assets. To address this gap, we present PrevizWhiz, a system that leverages rough 3D scenes in combination with generative image and video models to create stylized video previews. The workflow integrates frame-level image restyling with adjustable resemblance, time-based editing through motion paths or external video inputs, and refinement into high-fidelity video clips. A study with filmmakers demonstrates that our system lowers technical barriers for film-makers, accelerates creative iteration, and effectively bridges the communication gap, while also surfacing challenges of continuity, authorship, and ethical consideration in AI-assisted filmmaking.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper22
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao 等ICCV 2023 · 被引用 13,211 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li 等NeurIPS 2022 · 被引用 8,965 次
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 被引用 6,759 次
相关 Paper
- CollageVis: Rapid Previsualization Tool for Indie Filmmaking using Video CollagesHye-Young Jo, Ryo Suzuki, Yoonji KimCHI 2024 · 被引用 5 次
- CineVision: An Interactive Pre-visualization Storyboard System for Director-Cinematographer CollaborationZheng Wei, Hongtao Wu, Lvmin Zhang, Xian Xu 等UIST 2025 · 被引用 8 次
- One Week in the Future: Previs Design Futuring for HCI ResearchAlexander Ivanov, Tim Au Yeung, Kathryn Blair, Kurtis Thorvald Danyluk 等CHI 2022 · 被引用 11 次
- SketchDynamics: Exploring Free-Form Sketches for Dynamic Intent Expression in Animation GenerationBoyu Li, Lin-Ping Yuan, Zeyu Wang, Hongbo FuCHI 2026 · 被引用 1 次
- I2V3D: Controllable Image-to-Video Generation with 3D GuidanceZhiyuan Zhang, Dongdong Chen, Jing LiaoICCV 2025 · 被引用 3 次
