SkeletonContext: Skeleton-side Context Prompt Learning for Zero-Shot Skeleton-based Action Recognition
Ning Wang, Tieyue Wu, Naeha Sharif, Farid Boussaïd, Guangming Zhu, Lin Mei, Mohammed Bennamoun, Liang Zhang
摘要
Zero-shot skeleton-based action recognition aims to recognize unseen actions by transferring knowledge from seen categories through semantic descriptions. Most existing methods typically align skeleton features with textual embeddings within a shared latent space. However, the absence of contextual cues, such as objects involved in the action, introduces an inherent gap between skeleton and semantic representations, making it difficult to distinguish visually similar actions. To address this, we propose Skele-tonContext, a prompt-based framework that enriches skeletal motion representations with language-driven contextual semantics. Specifically, we introduce a Cross-Modal Context Prompt Module, which leverages a pretrained language model to reconstruct masked contextual prompts under guidance derived from LLMs. This design effectively transfers linguistic context to the skeleton encoder for instance-level semantic grounding and improved crossmodal alignment. In addition, a Key-Part Decoupling Module is incorporated to decouple motion-relevant joint features, ensuring robust action understanding even in the absence of explicit object interactions. Extensive experiments on multiple benchmarks demonstrate that SkeletonContext achieves state-of-the-art performance under both conventional and generalized zero-shot settings, validating its effectiveness in reasoning about context and distinguishing fine-grained, visually similar actions. Our project is available at https : / / github . com / NingWang2049 / skeletoncontext.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper16
- VL-BERT: Pre-training of Generic Visual-Linguistic RepresentationsWeijie Su, Xizhou Zhu, Yue Cao, Bin Li 等ICLR 2020 · 被引用 1,825 次
- Conditional Prompt Learning for Vision-Language ModelsKaiyang Zhou, Jingkang Yang, Chen Change Loy, Ziwei LiuCVPR 2022 · 被引用 1,438 次
- Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action RecognitionYuxin Chen, Ziqi Zhang, Chunfeng Yuan, Bing Li 等ICCV 2021 · 被引用 871 次
- InfoGCN: Representation Learning for Human Skeleton-based Action RecognitionHyung-Gun Chi, Myoung Hoon Ha, Seung-geun Chi, Sang Wan Lee 等CVPR 2022 · 被引用 383 次
- Fine-Grained Action Retrieval Through Multiple Parts-of-Speech EmbeddingsMichael Wray, Gabriela Csurka, Diane Larlus, Dima DamenICCV 2019 · 被引用 185 次
相关 Paper
- Semantic-guided Cross-Modal Prompt Learning for Skeleton-based Zero-shot Action RecognitionAnqi Zhu, Jingmin Zhu, James Bailey, Mingming Gong 等CVPR 2025
- Part-Aware Unified Representation of Language and Skeleton for Zero-Shot Action RecognitionAnqi Zhu, Qiuhong Ke, Mingming Gong, James BaileyCVPR 2024 · 被引用 16 次
- Frequency-Semantic Enhanced Variational Autoencoder for Zero-Shot Skeleton-Based Action RecognitionWenhan Wu, Zhishuai Guo, Chen Chen, Hongfei Xue 等ICCV 2025 · 被引用 4 次
- Fine-Grained Side Information Guided Dual-Prompts for Zero-Shot Skeleton Action RecognitionYang Chen, Jingcai Guo, Tian He, Xiaocheng Lu 等ACM MM 2024 · 被引用 13 次
- Skeleton-in-Context: Unified Skeleton Sequence Modeling with In-Context LearningXinshun Wang, Zhongbin Fang, Xia Li, Xiangtai Li 等CVPR 2024 · 被引用 12 次
