Estimating Body and Hand Motion in an Ego-sensed World
Brent Yi, Vickie Ye, Maya Zheng, Yunqi Li, Lea Müller, Georgios Pavlakos, Yi Ma, Jitendra Malik, Angjoo Kanazawa
2025Year
20Top-tier citations
Abstract
Egocentric Inputs Body Pose, Height, and Hands Example Results Figure 1 . EgoAllo. We present a system that estimates human body pose, height, and hand parameters from egocentric SLAM poses and images. Outputs capture the wearer's actions in the allocentric reference frame of the scene, which we visualize here with 3D reconstructions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b272dcc5-9143-49d1-af0e-de9bce618df5Cited by top-tier papers20
- Cameras as Relative Positional EncodingRuilong Li, Brent Yi, Junchen Liu, Hang Gao et al.NeurIPS 2025 · 113 citations
- Whole-Body Conditioned Egocentric Video PredictionYutong Bai, Danny Tran, Amir Bar, Yann LeCun et al.NeurIPS 2025 · 33 citations
- OpenMMEgo: Enhancing Egocentric Understanding for LMMs with Open Weights and DataHao Luo, Zihao Yue, Wanpeng Zhang, Yicheng Feng et al.NeurIPS 2025 · 10 citations
- Seeing without Pixels: Perception from Camera TrajectoriesZihui Xue, Kristen Grauman, Dima Damen, Andrew Zisserman et al.CVPR 2026 · 4 citations
- EgoPoseFormer v2: Accurate Egocentric Human Motion Estimation for AR/VRZhenyu Li, Sai Kumar Dwivedi, Filip Maric, Carlos Chacón et al.CVPR 2026 · 3 citations
Builds on50
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
Related papers
- Ego4o: Egocentric Human Motion Capture and Understanding from Multi-Modal InputJian Wang, Rishabh Dabral, Diogo C. Luvizon, Zhe Cao et al.CVPR 2025
- EgoLocate: Real-time Motion Capture, Localization, and Mapping with Sparse Body-mounted SensorsXinyu Yi, Yuxiao Zhou, Marc Habermann, Vladislav Golyanik et al.SIGGRAPH 2023 · 62 citations
- Egocentric Pose Estimation from Human Vision SpanHao Jiang, Vamsi Krishna IthapuICCV 2021 · 37 citations
- Ego-Body Pose Estimation via Ego-Head Pose EstimationJiaman Li, C. Karen Liu, Jiajun WuCVPR 2023
- Egocentric Action-Aware Inertial Localization in Point Clouds with Vision-Language GuidanceMingfang Zhang, Ryo Yonetani, Yifei Huang, Liangyang Ouyang et al.ICCV 2025
