: An Affordance-Aware Hierarchical Model for General Robotic Manipulation
Rongtao Xu, Jian Zhang, Minghao Guo, Youpeng Wen, Haoting Yang, Min Lin, Jianzheng Huang, Zhe Li, Kaidong Zhang, Liqiong Wang, Yuxuan Kuang, Meng Cao
摘要
Robotic manipulation faces critical challenges in understanding spatial affordances-the “where” and “how” of object interactions-essential for complex manipulation tasks like wiping a board or stacking objects. Existing methods, including modular-based and end-to-end approaches, often lack robust spatial reasoning capabilities. Unlike recent point-based and flow-based affordance methods that focus on dense spatial representations or trajectory modeling, we propose , a hierarchical affordance-aware diffusion model that decomposes manipulation task into highlevel spatial affordance understanding and low-level action execution. leverages the Embodiment-Agnostic Affordance Representation, which captures object-centric spatial affordances by predicting contact point and postcontact trajectories. is pre-trained on 1 million contact points data and fine-tuned on annotated trajectories, enabling generalization across platforms. Key components include Position Offset Attention for motion-aware feature extraction and a Spatial Information Aggregation Layer for precise coordinate mapping. The output is executed by the action execution module. Experiments on multiple robotic systems (Franka, Kinova, Realman and Dobot) demonstrate 's superior performance in complex tasks, showcasing its efficiency, flexibility, and real-world applicability.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper9
- Embodied-R1: Reinforced Embodied Reasoning for General Robotic ManipulationYifu Yuan, Haiqin Cui, Yaoting Huang, Yibin Chen 等ICLR 2026 · 被引用 48 次
- Thinking with Geometry: Active Geometry Integration for Spatial ReasoningHaoyuan Li, Qihang Cao, Tao Tang, Kun Xiang 等ICML 2026 · 被引用 12 次
- Spatially Guided Training for Vision-Language-Action ModelJinhui Ye, Fangjing Wang, Ning Gao, Junqiu Yu 等ICLR 2026 · 被引用 6 次
- Thinking with Drafts: Speculative Temporal Reasoning for Efficient Long Video UnderstandingPengfei Hu, Meng Cao, Yingyao Wang, Yi Wang 等CVPR 2026 · 被引用 3 次
- Obstruction Reasoning for Robotic GraspingRunyu Jiao, Matteo Bortolon, Francesco Giuliari, Alice Fasoli 等CVPR 2026 · 被引用 2 次
它引用的顶会 Paper16
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao 等ICCV 2023 · 被引用 13,211 次
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 被引用 5,568 次
- DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 StepsCheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen 等NeurIPS 2022 · 被引用 2,653 次
- Unleashing Large-Scale Video Generative Pre-training for Visual Robot ManipulationHongtao Wu, Ya Jing, Chilam Cheang, Guangzeng Chen 等ICLR 2024 · 被引用 309 次
- Where2Act: From Pixels to Actions for Articulated 3D ObjectsKaichun Mo, Leonidas J. Guibas, Mustafa Mukadam, Abhinav Gupta 等ICCV 2021 · 被引用 240 次
相关 Paper
- AffordDP: Generalizable Diffusion Policy with Transferable AffordanceShijie Wu, Yihang Zhu, Yunao Huang, Kaizhen Zhu 等CVPR 2025
- H2OFlow: Grounding Human-Object Affordances with 3D Generative Models and Dense Diffused FlowsHarry Zhang, Luca CarloneICLR 2026 · 被引用 2 次
- Learning Precise Affordances From Egocentric Videos for Robotic ManipulationGen Li, Nikolaos Tsagkas, Jifei Song, Ruaridh Mon-Williams 等ICCV 2025 · 被引用 6 次
- NavA³: Understanding Any Instruction, Navigating Anywhere, Finding AnythingLingfeng Zhang, Xiaoshuai Hao, Yingbo Tang, Haoxiang Fu 等ACL 2026 · 被引用 24 次
- From Seeing to Doing: Bridging Reasoning and Decision for Robotic ManipulationYifu Yuan, Haiqin Cui, Yibin Chen, Zibin Dong 等ICLR 2026 · 被引用 41 次
