One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformer

Fusion E D (a) Previous multi-stage pipeline (b) Our one-stage pipeline Figure 1. A comparison of existing whole-body mesh recovery methods and ours. Most existing methods leverage a multi-stage pipeline which uses separate expert models to process body component (e.g., E1: HeadNet, E2: HandNet, E3: BodyNet) and fuse them to get the whole-body prediction in a copy-paste manner. The result (from [48]) produces unnatural wrist poses. In contrast, our pipeline is a neat one-stage framework with a single encoder-decoder and can predict more accurately with natural meshes.