Beyond Binary Contrast: Modeling Continuous Skeleton Action Spaces with Transitional Anchors
Yingjie Feng, Yi Wang, Jiaze Wang, Anfeng Liu, Zhuotao Tian
摘要
Self-supervised contrastive learning has emerged as a powerful paradigm for skeleton-based action recognition by enforcing consistency in the embedding space. However, existing methods rely on binary contrastive objectives that overlook the intrinsic continuity of human motion, resulting in fragmented feature clusters and rigid class boundaries. To address these limitations, we propose TranCLR, a Transitional anchor-based Contrastive Learning framework that captures the continuous geometry of the action space. Specifically, the proposed Action Transitional Anchor Construction (ATAC) explicitly models the geometric structure of transitional states to enhance the model's perception of motion continuity. Building upon these anchors, a Multi-Level Geometric Manifold Calibration (MGMC) mechanism is introduced to adaptively calibrate the action manifold across multiple levels of continuity, yielding a smoother and more discriminative representation space. Extensive experiments on the NTU RGB+D, NTU RGB+D 120 and PKU-MMD datasets demonstrate that TranCLR achieves superior accuracy and calibration performance, effectively learning continuous and uncertainty-aware skeleton representations. The code is available at https://github. com/Philchieh/TranCLR.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper37
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec 等NeurIPS 2020 · 被引用 9,171 次
- Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action RecognitionYuxin Chen, Ziqi Zhang, Chunfeng Yuan, Bing Li 等ICCV 2021 · 被引用 871 次
- Contrastive Learning from Extremely Augmented Skeleton Sequences for Self-Supervised Action RecognitionTianyu Guo, Hong Liu, Zhan Chen, Mengyuan Liu 等AAAI 2022 · 被引用 206 次
- Skeleton-Contrastive 3D Action Representation LearningFida Mohammad Thoker, Hazel Doughty, Cees G. M. SnoekACM MM 2021 · 被引用 158 次
相关 Paper
- Hierarchical Consistent Contrastive Learning for Skeleton-Based Action Recognition with Growing AugmentationsJiahang Zhang, Lilang Lin, Jiaying LiuAAAI 2023 · 被引用 84 次
- SCD-Net: Spatiotemporal Clues Disentanglement Network for Self-Supervised Skeleton-Based Action RecognitionCong Wu, Xiao-Jun Wu, Josef Kittler, Tianyang Xu 等AAAI 2024 · 被引用 29 次
- 3D Human Action Representation Learning via Cross-View Consistency PursuitLinguo Li, Minsi Wang, Bingbing Ni, Hang Wang 等CVPR 2021
- Actionlet-Dependent Contrastive Learning for Unsupervised Skeleton-Based Action RecognitionLilang Lin, Jiahang Zhang, Jiaying LiuCVPR 2023
- MaskCLR: Attention-Guided Contrastive Learning for Robust Action Representation LearningMohamed Abdelfattah, Mariam Hassan, Alexandre AlahiCVPR 2024
