COAP: Compositional Articulated Occupancy of People
Marko Mihajlovic, Shunsuke Saito, Aayush Bansal, Michael Zollhöfer, Siyu Tang
摘要
We present a novel neural implicit representation for articulated human bodies. Compared to explicit template meshes, neural implicit body representations provide an efficient mechanism for modeling interactions with the environment, which is essential for human motion reconstruction and synthesis in 3D scenes. However, existing neural implicit bodies suffer from either poor generalization on highly articulated poses or slow inference time. In this work, we observe that prior knowledge about the human body's shape and kinematic structure can be leveraged to improve generalization and efficiency. We decompose the full-body geometry into local body parts and employ a part-aware encoder-decoder architecture to learn neural articulated occupancy that models complex deformations locally. Our local shape encoder represents the body deformation of not only the corresponding body part but also the neighboring body parts. The decoder incorporates the geometric constraints of local body shape which significantly improves pose generalization. We demonstrate that our model is suitable for resolving self-intersections and collisions with 3D environments. Quantitative and qualitative experiments show that our method largely outperforms existing solutions in terms of both efficiency and accuracy.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper34
- NeMF: Neural Motion Fields for Kinematic AnimationChengan He, Jun Saito, James Zachary, Holly E. Rushmeier 等NeurIPS 2022 · 被引用 84 次
- EVA3D: Compositional 3D Human Generation from 2D Image CollectionsFangzhou Hong, Zhaoxi Chen, Yushi Lan, Liang Pan 等ICLR 2023 · 被引用 35 次
- Probabilistic Human Mesh Recovery in 3D Scenes from Egocentric ViewsSiwei Zhang, Qianli Ma, Yan Zhang, Sadegh Aliakbarian 等ICCV 2023 · 被引用 34 次
- PoseVocab: Learning Joint-structured Pose Embeddings for Human Avatar ModelingZhe Li, Zerong Zheng, Yuxiao Liu, Boyao Zhou 等SIGGRAPH 2023 · 被引用 34 次
- GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-MeshJing Wen, Xiaoming Zhao, Zhongzheng Ren, Alexander G. Schwing 等CVPR 2024 · 被引用 33 次
它引用的顶会 Paper16
- AMASS: Archive of Motion Capture As Surface ShapesNaureen Mahmood, Nima Ghorbani, Nikolaus F. Troje, Gerard Pons-Moll 等ICCV 2019 · 被引用 1,784 次
- Learning to Reconstruct 3D Human Pose and Shape via Model-Fitting in the LoopNikos Kolotouros, Georgios Pavlakos, Michael J. Black, Kostas DaniilidisICCV 2019 · 被引用 1,139 次
- HuMoR: 3D Human Motion Model for Robust Pose EstimationDavis Rempe, Tolga Birdal, Aaron Hertzmann, Jimei Yang 等ICCV 2021 · 被引用 398 次
- Resolving 3D Human Pose Ambiguities With 3D Scene ConstraintsMohamed Hassan, Vasileios Choutas, Dimitrios Tzionas, Michael J. BlackICCV 2019 · 被引用 384 次
- SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit ShapesXu Chen, Yufeng Zheng, Michael J. Black, Otmar Hilliges 等ICCV 2021 · 被引用 267 次
相关 Paper
- VolumetricSMPL: A Neural Volumetric Body Model for Efficient Interactions, Contacts, and CollisionsMarko Mihajlovic, Siwei Zhang, Gen Li, Kaifeng Zhao 等ICCV 2025 · 被引用 2 次
- LEAP: Learning Articulated Occupancy of PeopleMarko Mihajlovic, Yan Zhang, Michael J. Black, Siyu TangCVPR 2021
- SPAMs: Structured Implicit Parametric ModelsPablo R. Palafox, Nikolaos Sarafianos, Tony Tung, Angela DaiCVPR 2022 · 被引用 26 次
- Neural Body: Implicit Neural Representations With Structured Latent Codes for Novel View Synthesis of Dynamic HumansSida Peng, Yuanqing Zhang, Yinghao Xu, Qianqian Wang 等CVPR 2021
- Self-supervised Learning of Implicit Shape Representation with Dense Correspondence for Deformable ObjectsBaowen Zhang, Jiahe Li, Xiaoming Deng, Yinda Zhang 等ICCV 2023 · 被引用 10 次
