DemoFunGrasp: Universal Dexterous Functional Grasping via Demonstration-Editing Reinforcement Learning
Chuan Mao, Haoqi Yuan, Ziye Huang, Chaoyi Xu, Kai Ma, Zongqing Lu
摘要
Reinforcement learning (RL) has achieved great success in dexterous grasping, significantly improving grasp performance and generalization from simulation to the real world. However, fine-grained functional grasping, which is essential for downstream manipulation tasks, remains underexplored and faces several challenges: the complexity of specifying goals and reward functions for functional grasps across diverse objects, the difficulty of multi-task RL exploration, and the challenge of sim-to-real transfer. In this work, we propose DemoFunGrasp for universal dexterous functional grasping. We factorize functional grasping conditions into two complementary components — grasping style and affordance — and integrate them into an RL framework that can learn to grasp any object with any functional grasping condition. To address the multi-task optimization challenge, we leverage a single grasping demonstration and reformulate the RL problem as one-step demonstration editing, substantially enhancing sample efficiency and performance.Experimental results in both simulation and the real world show that DemoFunGrasp generalizes to unseen combinations of objects, affordances, and grasping styles, outperforming baselines in both success rate and functional grasping accuracy. In addition to strong sim-to-real capability, by incorporating a vision-language model (VLM) for planning, our system achieves autonomous instruction-following grasp execution.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper16
- UniDexGrasp++: Improving Dexterous Grasping Policy Learning via Geometry-aware Curriculum and Iterative Generalist-Specialist LearningWeikang Wan, Haoran Geng, Yun Liu, Zikang Shan 等ICCV 2023 · 被引用 160 次
- HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object InteractionYunze Liu, Yun Liu, Che Jiang, Kangbo Lyu 等CVPR 2022 · 被引用 126 次
- DexGraspVLA: A Vision-Language-Action Framework Towards General Dexterous GraspingYifan Zhong, Xuchuan Huang, Ruochong Li, Ceyao Zhang 等AAAI 2026 · 被引用 89 次
- Grasp as You Say: Language-guided Dexterous Grasp GenerationYi-Lin Wei, Jian-Jian Jiang, Chengyi Xing, Xiantuo Tan 等NeurIPS 2024 · 被引用 85 次
- AffordPose: A Large-scale Dataset of Hand-Object Interactions with Affordance-driven Hand PoseJuntao Jian, Xiuping Liu, Manyi Li, Ruizhen Hu 等ICCV 2023 · 被引用 78 次
相关 Paper
- DemoGrasp: Universal Dexterous Grasping from a Single DemonstrationHaoqi Yuan, Ziye Huang, Ye Wang, Chuan Mao 等ICLR 2026 · 被引用 14 次
- AffordDexGrasp: Open-Set Language-Guided Dexterous Grasp With Generalizable-Instructive AffordanceYi-Lin Wei, Mu Lin, Yuhao Lin, Jian-Jian Jiang 等ICCV 2025 · 被引用 8 次
- DexVLG: Dexterous Vision-Language-Grasp Model at ScaleJiawei He, Danshi Li, Xinqiang Yu, Zekun Qi 等ICCV 2025 · 被引用 6 次
- G-DexGrasp: Generalizable Dexterous Grasping Synthesis via Part-Aware Prior Retrieval and Prior-Assisted GenerationJuntao Jian, Xiuping Liu, Zixuan Chen, Manyi Li 等ICCV 2025 · 被引用 2 次
- Efficient Residual Learning with Mixture-of-Experts for Universal Dexterous GraspingZiye Huang, Haoqi Yuan, Yuhui Fu, Zongqing LuICLR 2025
