SuDA: Support-based Domain Adaptation for Sim2Real Hinge Joint Tracking with Flexible Sensors
Jiawei Fang, Haishan Song, Chengxu Zuo, Xiaoxia Gao, Xiaowei Chen, Shihui Guo, Yipeng Qin
Abstract
Flexible sensors hold promise for human motion capture (MoCap), offering advantages such as wearability, privacy preservation, and minimal constraints on natural movement. However, existing flexible sensor based MoCap methods rely on deep learning and necessitate large and diverse labeled datasets for training. These data typically need to be collected in MoCap studios with specialized equipment and substantial manual labor, making them difficult and expensive to obtain at scale. Thanks to the high-linearity of flexible sensors, we address this challenge by proposing a novel Sim2Real solution for hinge joint tracking based on domain adaptation, eliminating the need for labeled data yet achieving comparable accuracy to supervised learning. Our solution relies on a novel Support-based Domain Adaptation method, namely SuDA, which aligns the supports of the predictive functions rather than the instancedependent distributions between the source and target domains. Extensive experimental results show the effectiveness of our method and its superiority over state-of-the-art distribution-based domain adaptation methods in our task.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f2b153ad-e524-4b8e-af37-b68cd0f54ae7Cited by top-tier papers1
Ask how each one uses itBuilds on19
- AMASS: Archive of Motion Capture As Surface ShapesNaureen Mahmood, Nima Ghorbani, Nikolaus F. Troje, Gerard Pons-Moll et al.ICCV 2019 · 1,784 citations
- Cycle Self-Training for Domain AdaptationHong Liu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 236 citations
- TransPose: real-time 3D human translation and pose estimation with six inertial sensorsXinyu Yi, Yuxiao Zhou, Feng XuSIGGRAPH 2021 · 200 citations
- Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial SensorsXinyu Yi, Yuxiao Zhou, Marc Habermann, Soshi Shimada et al.CVPR 2022 · 198 citations
- MOTSynth: How Can Synthetic Data Help Pedestrian Detection and Tracking?Matteo Fabbri, Guillem Brasó, Gianluca Maugeri, Orcun Cetintas et al.ICCV 2021 · 128 citations
Related papers
- Geometric Unsupervised Domain Adaptation for Semantic SegmentationVitor Guizilini, Jie Li, Rares Ambrus, Adrien GaidonICCV 2021 · 45 citations
- MoCaPose: Motion Capturing with Textile-integrated Capacitive Sensors in Loose-fitting Smart GarmentsBo Zhou, Daniel Geissler, Marc Faulhaber, Clara Elisabeth Gleiss et al.UbiComp 2023 · 26 citations
- Source-free Domain Adaptive Human Pose EstimationQucheng Peng, Ce Zheng, Chen ChenICCV 2023 · 36 citations
- MAMMA: Markerless Accurate Multi-person Motion AcquisitionHanz Cuevas Velasquez, Anastasios Yiannakidis, Soyong Shin, Giorgio Becherini et al.CVPR 2026
- Self-Adaptive Motion Tracking against On-body Displacement of Flexible SensorsChengxu Zuo, Jiawei Fang, Shihui Guo, Yipeng QinNeurIPS 2023 · 9 citations
