Reading Your Actions: Learning Generalizable Action Representations via Pre-training AEMG
Zhenghao Huang, Huilin Yao, Kaikai Wang, Lin Shu
摘要
A fundamental role in decoding human motor intent and enabling intuitive human-computer interaction is played by electromyography (EMG). However, its generalization capability across subjects, devices, and tasks remains substantially limited by data heterogeneity, label scarcity, and the lack of a unified representational framework. To bridge this gap, we propose Any Electromyography (AEMG), the first large-scale, self-supervised representation learning framework for EMG. AEMG reconceptualizes neuromuscular dynamics linguistically, utilizing a novel Neuromuscular Contraction Tokenizer (NCT) to translate discrete muscle contractions into structural words and temporal activation patterns into coherent sentences. Furthermore, we compile the largest cross-device EMG signal vocabulary to date, enabling seamless transfer across arbitrary channel topologies and sampling rates. Experiments demonstrate that AEMG improves the zero-shot leave-one-subject-out (LOSO) accuracy by 5.79-9.25% compared to six stateof-the-art baselines, and achieves more than 90% few-shot adaptation performance with only 5% of target user data. Our work has proposed the concept of EMG signals as a cross-device physiological language, learned their grammar from massive amounts of data, and laid the groundwork for a single-training, universally applicable EMG foundation model. Our code, demos, and more resources are available at https://github.com/AEMG-series/ AEMG.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper5
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida 等NeurIPS 2022 · 被引用 24,707 次
- Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIWei-Bang Jiang, Li-Ming Zhao, Bao-Liang LuICLR 2024 · 被引用 298 次
- Cluster Alignment With a Teacher for Unsupervised Domain AdaptationZhijie Deng, Yucen Luo, Jun ZhuICCV 2019 · 被引用 241 次
- Unsupervised Domain Adaptation via Structurally Regularized Deep ClusteringHui Tang, Ke Chen, Kui JiaCVPR 2020
- Reading Your Heart: Learning ECG Words and Sentences via Pre-training ECG Language ModelJiarui Jin, Haoyu Wang, Hongyan Li, Jun Li 等ICLR 2025
相关 Paper
- Translating Signals to Languages for sEMG-Based Activity RecognitionMing Wang, Haoxuan Qu, Qiuhong Ke, Wei Zhou 等CVPR 2026
- emg2speech: synthesizing speech from electromyography using self-supervised speech modelsHarshavardhana T. Gowda, Daniel C. Comstock, Lee M. MillerACL 2026 · 被引用 2 次
- EMBridge: Enhancing Gesture Generalization from EMG Signals Through Cross-modal Representation LearningWenhui Cui, Christopher Michael Sandino, Hadi Pouransari, Ran Liu 等ICLR 2026
- Learning Unseen Emotions from Gestures via Semantically-Conditioned Zero-Shot Perception with Adversarial AutoencodersAbhishek Banerjee, Uttaran Bhattacharya, Aniket BeraAAAI 2022 · 被引用 19 次
- From Pose to Muscle: Multimodal Learning for Piano Hand Muscle ElectromyographyRuofan Liu, Yichen Peng, Takanori Oku, Chen-Chieh Liao 等NeurIPS 2025 · 被引用 6 次
