Dense Correspondences between Human Bodies via Learning Transformation Synchronization on Graphs
Xiangru Huang, Haitao Yang, Etienne Vouga, Qixing Huang
Abstract
We introduce an approach for establishing dense correspondences between partial scans of human models and a complete template model. Our approach's key novelty lies in formulating dense correspondence computation as initializing and synchronizing local transformations between the scan and the template model. We introduce an optimization formulation for synchronizing transformations among a graph of the input scan, which automatically enforces smoothness of correspondences and recovers the underlying articulated deformations. We then show how to convert the iterative optimization procedure among a graph of the input scan into an end-to-end trainable network. The network design utilizes additional trainable parameters to break the barrier of the original optimization formulation's exact and robust recovery conditions. Experimental results on benchmark datasets demonstrate that our approach considerably outperforms baseline approaches.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ab60db1d-ec09-48e8-b934-c23b0c504102Cited by top-tier papers1
Ask how each one uses itBuilds on2
Related papers
- BodyMap: Learning Full-Body Dense Correspondence MapAnastasia Ianina, Nikolaos Sarafianos, Yuanlu Xu, Ignacio Rocco et al.CVPR 2022 · 15 citations
- LoopReg: Self-supervised Learning of Implicit Surface Correspondences, Pose and Shape for 3D Human Mesh RegistrationBharat Lal Bhatnagar, Cristian Sminchisescu, Christian Theobalt, Gerard Pons-MollNeurIPS 2020 · 159 citations
- End-to-End CAD Model Retrieval and 9DoF Alignment in 3D ScansArmen Avetisyan, Angela Dai, Matthias NießnerICCV 2019 · 88 citations
- SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar NetworksShunsuke Saito, Jinlong Yang, Qianli Ma, Michael J. BlackCVPR 2021
- HumanGPS: Geodesic PreServing Feature for Dense Human CorrespondencesFeitong Tan, Danhang Tang, Mingsong Dou, Kaiwen Guo et al.CVPR 2021
