SIAM: Towards Generalizable Articulated Object Modeling via Single Robot-Object Interaction
Yuyan Liu, Li Zhang, Di Wu, Yan Zhang, Anran Huang, Zhi Wang, Liu Liu, Dan Guo
摘要
Articulated object modeling, which represents interconnected rigid bodies with their geometry, part segmentation, articulation tree, and physical properties, is crucial for robotic perception and manipulation. Recently existing methods like SAGCI leverage Interactive Perception (IP) to refine models through robot interaction. However, SAGCI suffers from prior-dependency (requiring initialization), neglects kinematic/dynamic constraints, and generates non-watertight meshes. To overcome these limitations, we propose SIAM, a novel framework for efficient and generalizable Single-Interaction Articulated Modeling. Given an initial point cloud, SIAM first enables minimal robot interaction to trigger object motion. It then precisely segments parts by analyzing point cloud differences pre-and post-interaction. For joint parameter estimation, we introduce an optimization incorporating novel kinematic energy constraints, enhancing physical consistency. Finally, we reconstruct a high-quality, topologically watertight mesh by learning 3D Gaussian Primitives from multi-view RGB-D observations under deformation. Extensive experiments on the PartNet-Mobility benchmark demonstrate state-of-the-art articulation modeling performance. Successful real-world deployment with an xArm robot further validates the framework's practicality and transferability. SIAM achieves accurate, prior-free modeling with significantly reduced interaction cost. Code will be publicly available upon acceptance.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- Where2Act: From Pixels to Actions for Articulated 3D ObjectsKaichun Mo, Leonidas J. Guibas, Mustafa Mukadam, Abhinav Gupta 等ICCV 2021 · 被引用 240 次
- A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape RepresentationJiteng Mu, Weichao Qiu, Adam Kortylewski, Alan L. Yuille 等ICCV 2021 · 被引用 138 次
- VAT-Mart: Learning Visual Action Trajectory Proposals for Manipulating 3D ARTiculated ObjectsRuihai Wu, Yan Zhao, Kaichun Mo, Zizheng Guo 等ICLR 2022 · 被引用 119 次
- AKB-48: A Real-World Articulated Object Knowledge BaseLiu Liu, Wenqiang Xu, Haoyuan Fu, Sucheng Qian 等CVPR 2022 · 被引用 64 次
- Act the Part: Learning Interaction Strategies for Articulated Object Part DiscoverySamir Yitzhak Gadre, Kiana Ehsani, Shuran SongICCV 2021 · 被引用 64 次
相关 Paper
- Articulation in Motion: Prior-free Part Mobility Analysis for Articulated Objects By Dynamic-Static DisentanglementHao Ai, Wenjie Chang, Jianbo Jiao, Ales Leonardis 等ICLR 2026 · 被引用 7 次
- Building Interactable Replicas of Complex Articulated Objects via Gaussian SplattingYu Liu, Baoxiong Jia, Ruijie Lu, Junfeng Ni 等ICLR 2025
- Building Rearticulable Models for Arbitrary 3D Objects from 4D Point CloudsShaowei Liu, Saurabh Gupta, Shenlong WangCVPR 2023
- SPLART: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian SplattingShengjie Lin, Jiading Fang, Muhammad Zubair Irshad, Vitor Campagnolo Guizilini 等ICCV 2025 · 被引用 2 次
- Guiding Diffusion-Based Articulated Object Generation by Partial Point Cloud Alignment and Physical Plausibility ConstraintsJens U. Kreber, Joerg StuecklerICCV 2025 · 被引用 7 次
