CVPR2024

Multiplane Prior Guided Few-Shot Aerial Scene Rendering

Zihan Gao, Licheng Jiao, Lingling Li, Xu Liu, Fang Liu, Puhua Chen, Yuwei Guo

Abstract

Figure 1. Visualization of failure modes in NeRF and MPI. (a) MPI models scenes only in each single camera frustums and performs homography warping to render novel views. Insufficient sampling leads to incorrect depth and thus results in an overlapping ghosting effect. Large camera movement leads to cropped corners. However, high-frequency details seem to be successfully preserved. (b) NeRF models scenes in a continuous volumetric manner. If only sparse views with large camera movement are provided, some parts of the scene may be sampled very little or even never. Insufficient sampling leads to collapsed details and unexpected floaters. (c) Our approach combines the capabilities of NeRF with the perspective-friendly nature of MPI in aerial scenes to achieve photorealistic novel view renderings.