Virtual Camera Layout Generation using a Reference Video
Jung Eun Yoo, Kwanggyoon Seo, Sanghun Park, Jaedong Kim, Dawon Lee, Junyong Noh
Abstract
We propose a method that generates a virtual camera layout of a 3D animation scene by following the cinematic intention of a reference video. From a reference video, cinematic features such as the start frame, end frame, framing, camera movement, and the visual features of the subjects are extracted automatically. The extracted information is used to generate the virtual camera layout, which resembles the camera layout of the reference video. Our method handles stylized as well as human characters with body proportions different from those of humans. We demonstrate the effectiveness of our approach with various reference videos and 3D animation scenes. The user evaluation results show that the generated layouts are comparable to layouts created by the artist, allowing us to assert that our method can provide effective assistance to both novice and professional users when positioning a virtual camera.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Cited by top-tier papers1
Ask how each one uses itRelated papers
- Example-driven virtual cinematography by learning camera behaviorsHongda Jiang, Bin Wang, Xi Wang, Marc Christie et al.SIGGRAPH 2020 · 52 citations
- Cinematic Behavior Transfer via NeRF-based Differentiable FilmingXuekun Jiang, Anyi Rao, Jingbo Wang, Dahua Lin et al.CVPR 2024
- JAWS: Just A Wild Shot for Cinematic Transfer in Neural Radiance FieldsXi Wang, Robin Courant, Jinglei Shi, Éric Marchand et al.CVPR 2023
- An Interactive System for Supporting Creative Exploration of Cinematic Composition DesignsRui He, Huaxin Wei, Ying CaoUIST 2024 · 10 citations
- Shoot360: Normal View Video Creation from City Panorama FootageAnyi Rao, Linning Xu, Dahua LinSIGGRAPH 2022 · 5 citations
