SIAM: Towards Generalizable Articulated Object Modeling via Single Robot-Object Interaction
Yuyan Liu, Li Zhang, Di Wu, Yan Zhang, Anran Huang, Zhi Wang, Liu Liu, Dan Guo
Abstract
Articulated object modeling, which represents interconnected rigid bodies with their geometry, part segmentation, articulation tree, and physical properties, is crucial for robotic perception and manipulation. Recently existing methods like SAGCI leverage Interactive Perception (IP) to refine models through robot interaction. However, SAGCI suffers from prior-dependency (requiring initialization), neglects kinematic/dynamic constraints, and generates non-watertight meshes. To overcome these limitations, we propose SIAM, a novel framework for efficient and generalizable Single-Interaction Articulated Modeling. Given an initial point cloud, SIAM first enables minimal robot interaction to trigger object motion. It then precisely segments parts by analyzing point cloud differences pre-and post-interaction. For joint parameter estimation, we introduce an optimization incorporating novel kinematic energy constraints, enhancing physical consistency. Finally, we reconstruct a high-quality, topologically watertight mesh by learning 3D Gaussian Primitives from multi-view RGB-D observations under deformation. Extensive experiments on the PartNet-Mobility benchmark demonstrate state-of-the-art articulation modeling performance. Successful real-world deployment with an xArm robot further validates the framework's practicality and transferability. SIAM achieves accurate, prior-free modeling with significantly reduced interaction cost. Code will be publicly available upon acceptance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ff0fe213-73bb-4c28-a705-65beddccac4fBuilds on9
- Where2Act: From Pixels to Actions for Articulated 3D ObjectsKaichun Mo, Leonidas J. Guibas, Mustafa Mukadam, Abhinav Gupta et al.ICCV 2021 · 240 citations
- A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape RepresentationJiteng Mu, Weichao Qiu, Adam Kortylewski, Alan L. Yuille et al.ICCV 2021 · 138 citations
- VAT-Mart: Learning Visual Action Trajectory Proposals for Manipulating 3D ARTiculated ObjectsRuihai Wu, Yan Zhao, Kaichun Mo, Zizheng Guo et al.ICLR 2022 · 119 citations
- AKB-48: A Real-World Articulated Object Knowledge BaseLiu Liu, Wenqiang Xu, Haoyuan Fu, Sucheng Qian et al.CVPR 2022 · 64 citations
- Act the Part: Learning Interaction Strategies for Articulated Object Part DiscoverySamir Yitzhak Gadre, Kiana Ehsani, Shuran SongICCV 2021 · 64 citations
Related papers
- Articulation in Motion: Prior-free Part Mobility Analysis for Articulated Objects By Dynamic-Static DisentanglementHao Ai, Wenjie Chang, Jianbo Jiao, Ales Leonardis et al.ICLR 2026 · 7 citations
- Building Interactable Replicas of Complex Articulated Objects via Gaussian SplattingYu Liu, Baoxiong Jia, Ruijie Lu, Junfeng Ni et al.ICLR 2025
- Building Rearticulable Models for Arbitrary 3D Objects from 4D Point CloudsShaowei Liu, Saurabh Gupta, Shenlong WangCVPR 2023
- SPLART: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian SplattingShengjie Lin, Jiading Fang, Muhammad Zubair Irshad, Vitor Campagnolo Guizilini et al.ICCV 2025 · 2 citations
- Guiding Diffusion-Based Articulated Object Generation by Partial Point Cloud Alignment and Physical Plausibility ConstraintsJens U. Kreber, Joerg StuecklerICCV 2025 · 7 citations
