BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects

Time Time Figure 1 . Given a monocular RGBD sequence and 2D object mask (in the first frame only), our method performs causal 6-DoF tracking and 3D reconstruction of an unknown object. Without any prior knowledge of the object or interaction agent, our method generalizes well, handling flat and untextured surfaces, specular highlights, thin structures, severe occlusion, and a variety of interaction agents (human hand / body / robotic arm). The visualized meshes are directly output by the method.