DecomPose: Disentangling Cross-Category Optimization Contention for Category-Level 6D Object Pose Estimation
Yifan Gao, Lu Zou, Zhangjin Huang, Guoping Wang
Abstract
Category-level 6D object pose estimation is typically formulated as a multi-category joint learning problem with fully shared model parameters. However, pronounced geometric heterogeneity across categories entangles incompatible optimization signals in shared modules, resulting in gradient conflicts and negative transfer during training. To address this challenge, we first introduce gradient-based diagnostics to quantify module-level cross-category contention. Building on results of diagnostics, we propose De-comPose, a difficulty-aware decomposition framework that mitigates optimization contention via: (1) difficulty-aware gradient decoupling, which groups categories using a data-driven difficulty proxy and routes each instance to a group-specific correspondence branch to isolate incompatible updates; and (2) stability-driven asymmetric branching, which assigns higher-capacity branches to structurally simple categories as stable optimization anchors while constraining complex categories with lightweight branches to suppress noisy updates and alleviate negative transfer. Extensive experiments on REAL275, CAMERA25, and HouseCat6D demonstrate that DecomPose effectively reduces cross-category optimization contention and delivers superior pose estimation performance across multiple benchmarks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on11
- Gradient Surgery for Multi-Task LearningTianhe Yu, Saurabh Kumar, Abhishek Gupta, Sergey Levine et al.NeurIPS 2020 · 2,261 citations
- GigaPose: Fast and Robust Novel Object Pose Estimation via One CorrespondenceVan Nguyen Nguyen, Thibault Groueix, Mathieu Salzmann, Vincent LepetitCVPR 2024 · 67 citations
- IST-Net: Prior-free Category-level Pose Estimation with Implicit Space TransformationJianhui Liu, Yukang Chen, Xiaoqing Ye, Xiaojuan QiICCV 2023 · 64 citations
- Query6DoF: Learning Sparse Queries as Implicit Shape Prior for Category-Level 6DoF Pose EstimationRuiqi Wang, Xinggang Wang, Te Li, Rong Yang et al.ICCV 2023 · 31 citations
- When Large Multimodal Models Confront Evolving Knowledge: Challenges and ExplorationsKailin Jiang, Yuntao Du, Yukai Ding, Yuchen Ren et al.ICLR 2026 · 7 citations
Related papers
- Instance-Adaptive and Geometric-Aware Keypoint Learning for Category-Level 6D Object Pose EstimationXiao Lin, Wenfei Yang, Yuan Gao, Tianzhu ZhangCVPR 2024
- SD-Pose: Semantic Decomposition for Cross-Domain 6D Object Pose EstimationZhigang Li, Yinlin Hu, Mathieu Salzmann, Xiangyang JiAAAI 2021 · 16 citations
- GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise VotingYan Di, Ruida Zhang, Zhiqiang Lou, Fabian Manhardt et al.CVPR 2022 · 141 citations
- Leveraging Global Stereo Consistency for Category-Level Shape and 6D Pose Estimation from Stereo ImagesJunning Qiu, Minglei Lu, Fei Wang, Yu Guo et al.CVPR 2025
- Discovering Relationships Between Object Categories via Universal Canonical MapsNatalia Neverova, Artsiom Sanakoyeu, Patrick Labatut, David Novotný et al.CVPR 2021
