CVPR2024

Polar Matte: Fully Computational Ground-Truth-Quality Alpha Matte Extraction for Images and Video using Polarized Screen Matting

Kenji Enomoto, T. J. Rhodes, Brian L. Price, Gavin Miller

Abstract

Input images of target scene Extracted ground-truth alpha matte Target scene composited onto a new background Capture setup polarized screen polarization camera unpolarized light polarized light Figure 1. PolarMatte extraction method. A modern polarization camera with a color polarization filter array (CPFA) is used to capture four polarization states of a target scene and polarized background separately as input images. Our method extracts the alpha matte and foreground color which can be composited onto an arbitrary background. The highlighted regions show fine-details, glasses, and motion blur. We can computationally extract alpha mattes for dynamic scenes containing various materials without manual corrections.