Learning Human-to-Robot Handovers from Point Clouds
Sammy Joe Christen, Wei Yang, Claudia Pérez-D'Arpino, Otmar Hilliges, Dieter Fox, Yu-Wei Chao
Abstract
Sim-to-Real Transfer + Test Figure 1 . We introduce a framework to learn human-to-robot handover policies from point cloud input. Our policies take input from a wrist mounted camera and directly generate action output for the robot's end effector. We train our policies in a simulated handover environment, and evaluate on unseen handover motion and poses. We further transfer the model across physics simulators and to a real robotic platform.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 47b45e90-b38c-41db-afd5-6093bec0a1f4Cited by top-tier papers13
- GenH2R: Learning Generalizable Human-to-Robot Handover via Scalable Simulation, Demonstration, and ImitationZifan Wang, Junyu Chen, Ziqing Chen, Pengwei Xie et al.CVPR 2024 · 15 citations
- TACO: Benchmarking Generalizable Bimanual Tool-ACtion-Object UnderstandingYun Liu, Haolin Yang, Xu Si, Ling Liu et al.CVPR 2024 · 12 citations
- HORT: Monocular Hand-held Objects Reconstruction with TransformersZerui Chen, Rolandos Alexandros Potamias, Shizhe Chen, Cordelia SchmidICCV 2025 · 4 citations
- Position-Aware Guided Point Cloud Completion with CLIP ModelFeng Zhou, Qi Zhang, Ju Dai, Lei Li et al.AAAI 2025 · 1 citation
- DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion ControlKaifeng Zhao, Gen Li, Siyu TangICLR 2025 · 1 citation
Builds on13
- Habitat 2.0: Training Home Assistants to Rearrange their HabitatAndrew Szot, Alexander Clegg, Eric Undersander, Erik Wijmans et al.NeurIPS 2021 · 826 citations
- 6-DOF GraspNet: Variational Grasp Generation for Object ManipulationArsalan Mousavian, Clemens Eppner, Dieter FoxICCV 2019 · 673 citations
- Watch-And-Help: A Challenge for Social Perception and Human-AI CollaborationXavier Puig, Tianmin Shu, Shuang Li, Zilin Wang et al.ICLR 2021 · 170 citations
- HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object InteractionYunze Liu, Yun Liu, Che Jiang, Kangbo Lyu et al.CVPR 2022 · 126 citations
- ArtiBoost: Boosting Articulated 3D Hand-Object Pose Estimation via Online Exploration and SynthesisLixin Yang, Kailin Li, Xinyu Zhan, Jun Lv et al.CVPR 2022 · 82 citations
Related papers
- DexNDM: Closing the Reality Gap for Dexterous In-Hand Rotation via Joint-Wise Neural Dynamics ModelXueyi Liu, He Wang, Li YiICLR 2026 · 26 citations
- MobileH2R: Learning Generalizable Human to Mobile Robot Handover Exclusively from Scalable and Diverse Synthetic DataZifan Wang, Ziqing Chen, Junyu Chen, Jilong Wang et al.CVPR 2025
- DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated ObjectsChen Bao, Helin Xu, Yuzhe Qin, Xiaolong WangCVPR 2023
- Contact-Aware Neural DynamicsChangwei Jing, Jai Krishna Bandi, Jianglong Ye, Yan Duan et al.CVPR 2026 · 5 citations
- UniDexGrasp: Universal Robotic Dexterous Grasping via Learning Diverse Proposal Generation and Goal-Conditioned PolicyYinzhen Xu, Weikang Wan, Jialiang Zhang, Haoran Liu et al.CVPR 2023
