CVPR2023

BlendFields: Few-Shot Example-Driven Facial Modeling

Kacper Kania, Stephan J. Garbin, Andrea Tagliasacchi, Virginia Estellers, Kwang Moo Yi, Julien Valentin, Tomasz Trzcinski, Marek Kowalski

Abstract

Ours Rendered training expressions Novel expression Figure 1 . Teaser -Given five multi-view frames of different expressions, our approach generates a model capable of capturing the fine-grained details of a novel expression beyond the resolution of the underlying face model [15] (top right corner). This is achieved by blending the radiance fields computed for individual expressions, where the blending coefficients are modulated accordingly to local volumetric changes. These volumetric changes are measured as the difference in the tetrahedral volume of a mesh that deforms with the expression ( increase, decrease, and no change in volume). Such an approach allows BlendFields to render sharp, expression-dependent details of the face without increasing the resolution of the mesh (bottom right corner).