Hi-LASSIE: High-Fidelity Articulated Shape and Skeleton Discovery from Sparse Image Ensemble
Chun-Han Yao, Wei-Chih Hung, Yuanzhen Li, Michael Rubinstein, Ming-Hsuan Yang, Varun Jampani
Abstract
Instance parts Textured 3D shape or skeleton template Figure 1. Hi-LASSIE overview and sample reconstructions. Given 20-30 images of an articulated animal class, we first discover a generic 3D skeleton, then jointly optimize the camera viewpoints, skeleton articulations, as well as shared and instance-specific neural part shapes. Hi-LASSIE is able to produce high-fidelity shapes and texture without any pre-defined shape model or 3D skeleton annotations. The part-based representation also allows applications like animation and motion re-targeting.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0797a5db-8a7d-431c-a734-22101b5231c6Cited by top-tier papers21
- ARTIC3D: Learning Robust Articulated 3D Shapes from Noisy Web Image CollectionsChun-Han Yao, Amit Raj, Wei-Chih Hung, Michael Rubinstein et al.NeurIPS 2023 · 25 citations
- LEPARD: Learning Explicit Part Discovery for 3D Articulated Shape ReconstructionDi Liu, Anastasis Stathopoulos, Qilong Zhangli, Yunhe Gao et al.NeurIPS 2023 · 24 citations
- Template-free Articulated Neural Point Clouds for Reposable View SynthesisLukas Uzolas, Elmar Eisemann, Petr KellnhoferNeurIPS 2023 · 20 citations
- Template-free Articulated Gaussian Splatting for Real-time Reposable Dynamic View SynthesisDiwen Wan, Yuxiang Wang, Ruijie Lu, Gang ZengNeurIPS 2024 · 18 citations
- S3O: A Dual-Phase Approach for Reconstructing Dynamic Shape and Skeleton of Articulated Objects from Single Monocular VideoHao Zhang, Fang Li, Samyak Rawlekar, Narendra AhujaICML 2024 · 13 citations
Builds on26
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou et al.ICCV 2021 · 8,921 citations
- Soft Rasterizer: A Differentiable Renderer for Image-Based 3D ReasoningShichen Liu, Weikai Chen, Tianye Li, Hao LiICCV 2019 · 789 citations
- NeRD: Neural Reflectance Decomposition from Image CollectionsMark Boss, Raphael Braun, Varun Jampani, Jonathan T. Barron et al.ICCV 2021 · 608 citations
- Neural-PIL: Neural Pre-Integrated Lighting for Reflectance DecompositionMark Boss, Varun Jampani, Raphael Braun, Ce Liu et al.NeurIPS 2021 · 270 citations
Related papers
- LASSIE: Learning Articulated Shapes from Sparse Image Ensemble via 3D Part DiscoveryChun-Han Yao, Wei-Chih Hung, Yuanzhen Li, Michael Rubinstein et al.NeurIPS 2022 · 83 citations
- CASA: Category-agnostic Skeletal Animal ReconstructionYuefan Wu, Zeyuan Chen, Shaowei Liu, Zhongzheng Ren et al.NeurIPS 2022 · 47 citations
- NPC: Neural Point Characters from VideoShih-Yang Su, Timur M. Bagautdinov, Helge RhodinICCV 2023 · 32 citations
- LASR: Learning Articulated Shape Reconstruction From a Monocular VideoGengshan Yang, Deqing Sun, Varun Jampani, Daniel Vlasic et al.CVPR 2021
- DensePose 3D: Lifting Canonical Surface Maps of Articulated Objects to the Third DimensionRoman Shapovalov, David Novotný, Benjamin Graham, Patrick Labatut et al.ICCV 2021 · 10 citations
