Relightable and Animatable Neural Avatar from Sparse-View Video
Zhen Xu, Sida Peng, Chen Geng, Linzhan Mou, Zihan Yan, Jiaming Sun, Hujun Bao, Xiaowei Zhou
Abstract
Figure 1 . Reconstructing relightable and animatable neural avatar from sparse-view (or monocular) video. Our method takes only a sparse-view (or monocular) video as input and reconstructs a relightable and animatable neural avatar under unknown illumination, which can then be relit with arbitrary environment lights and animated with arbitrary motion sequences. Note that our method successfully captures the shininess of the skin and pants as well as the specular highlights on the t-shirt's plastisol printings.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9da33f36-cef4-4cdb-879a-bd3469862fa5Cited by top-tier papers23
- IntrinsicAvatar: Physically Based Inverse Rendering of Dynamic Humans from Monocular Videos via Explicit Ray TracingShaofei Wang, Bozidar Antic, Andreas Geiger, Siyu TangCVPR 2024 · 13 citations
- Instruct 4D-to-4D: Editing 4D Scenes as Pseudo-3D Scenes Using 2D DiffusionLinzhan Mou, Jun-Kun Chen, Yu-Xiong WangCVPR 2024 · 6 citations
- Relightable Full-Body Gaussian Codec AvatarsShaofei Wang, Tomas Simon, Igor Santesteban, Timur M. Bagautdinov et al.SIGGRAPH 2025 · 6 citations
- Diffuman4D: 4D Consistent Human View Synthesis From Sparse-View Videos With Spatio-Temporal Diffusion ModelsYudong Jin, Sida Peng, Xuan Wang, Tao Xie et al.ICCV 2025 · 5 citations
- NECA: Neural Customizable Human AvatarJunjin Xiao, Qing Zhang, Zhan Xu, Wei-Shi ZhengCVPR 2024 · 5 citations
Builds on22
- NeRD: Neural Reflectance Decomposition from Image CollectionsMark Boss, Raphael Braun, Varun Jampani, Jonathan T. Barron et al.ICCV 2021 · 608 citations
- Animatable Neural Radiance Fields for Modeling Dynamic Human BodiesSida Peng, Junting Dong, Qianqian Wang, Shangzhan Zhang et al.ICCV 2021 · 461 citations
- HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular VideoChung-Yi Weng, Brian Curless, Pratul P. Srinivasan, Jonathan T. Barron et al.CVPR 2022 · 411 citations
- Neural-PIL: Neural Pre-Integrated Lighting for Reflectance DecompositionMark Boss, Varun Jampani, Raphael Braun, Ce Liu et al.NeurIPS 2021 · 270 citations
- SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit ShapesXu Chen, Yufeng Zheng, Michael J. Black, Otmar Hilliges et al.ICCV 2021 · 267 citations
Related papers
- Relightable and Animatable Neural Avatars from VideosWenbin Lin, Chengwei Zheng, Jun-Hai Yong, Feng XuAAAI 2024 · 22 citations
- Neural Reconstruction of Relightable Human Model from Monocular VideoWenzhang Sun, Yunlong Che, Yandong Guo, Han HuangICCV 2023 · 20 citations
- HRAvatar: High-Quality and Relightable Gaussian Head AvatarDongbin Zhang, Yunfei Liu, Lijian Lin, Ye Zhu et al.CVPR 2025
- Relightable and Dynamic Gaussian Avatar Reconstruction from Monocular VideoSeonghwa Choi, Moonkyeong Choi, Mingyu Jang, Jaekyung Kim et al.ACM MM 2025 · 1 citation
- RANA: Relightable Articulated Neural AvatarsUmar Iqbal, Akin Caliskan, Koki Nagano, Sameh Khamis et al.ICCV 2023 · 14 citations
