Reading Your Actions: Learning Generalizable Action Representations via Pre-training AEMG
Zhenghao Huang, Huilin Yao, Kaikai Wang, Lin Shu
Abstract
A fundamental role in decoding human motor intent and enabling intuitive human-computer interaction is played by electromyography (EMG). However, its generalization capability across subjects, devices, and tasks remains substantially limited by data heterogeneity, label scarcity, and the lack of a unified representational framework. To bridge this gap, we propose Any Electromyography (AEMG), the first large-scale, self-supervised representation learning framework for EMG. AEMG reconceptualizes neuromuscular dynamics linguistically, utilizing a novel Neuromuscular Contraction Tokenizer (NCT) to translate discrete muscle contractions into structural words and temporal activation patterns into coherent sentences. Furthermore, we compile the largest cross-device EMG signal vocabulary to date, enabling seamless transfer across arbitrary channel topologies and sampling rates. Experiments demonstrate that AEMG improves the zero-shot leave-one-subject-out (LOSO) accuracy by 5.79-9.25% compared to six stateof-the-art baselines, and achieves more than 90% few-shot adaptation performance with only 5% of target user data. Our work has proposed the concept of EMG signals as a cross-device physiological language, learned their grammar from massive amounts of data, and laid the groundwork for a single-training, universally applicable EMG foundation model. Our code, demos, and more resources are available at https://github.com/AEMG-series/ AEMG.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 84825e6a-98fc-4c9c-bfff-b601a30ade4eBuilds on5
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
- Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIWei-Bang Jiang, Li-Ming Zhao, Bao-Liang LuICLR 2024 · 298 citations
- Cluster Alignment With a Teacher for Unsupervised Domain AdaptationZhijie Deng, Yucen Luo, Jun ZhuICCV 2019 · 241 citations
- Unsupervised Domain Adaptation via Structurally Regularized Deep ClusteringHui Tang, Ke Chen, Kui JiaCVPR 2020
- Reading Your Heart: Learning ECG Words and Sentences via Pre-training ECG Language ModelJiarui Jin, Haoyu Wang, Hongyan Li, Jun Li et al.ICLR 2025
Related papers
- Translating Signals to Languages for sEMG-Based Activity RecognitionMing Wang, Haoxuan Qu, Qiuhong Ke, Wei Zhou et al.CVPR 2026
- emg2speech: synthesizing speech from electromyography using self-supervised speech modelsHarshavardhana T. Gowda, Daniel C. Comstock, Lee M. MillerACL 2026 · 2 citations
- EMBridge: Enhancing Gesture Generalization from EMG Signals Through Cross-modal Representation LearningWenhui Cui, Christopher Michael Sandino, Hadi Pouransari, Ran Liu et al.ICLR 2026
- Learning Unseen Emotions from Gestures via Semantically-Conditioned Zero-Shot Perception with Adversarial AutoencodersAbhishek Banerjee, Uttaran Bhattacharya, Aniket BeraAAAI 2022 · 19 citations
- From Pose to Muscle: Multimodal Learning for Piano Hand Muscle ElectromyographyRuofan Liu, Yichen Peng, Takanori Oku, Chen-Chieh Liao et al.NeurIPS 2025 · 6 citations
