New Synthetic Goldmine: Hand Joint Angle-Driven EMG Data Generation Framework for Micro-Gesture Recognition
Nana Wang, Suli Wang, Gen Li, Pengfei Ren, Hao Su
Abstract
Electromyography (EMG)-based gesture recognition has emerged as a promising approach for human-computer interaction. However, its performance is often limited by the scarcity of labeled EMG data, significant cross-user variability, and poor generalization to unseen gestures. To address these challenges, we propose SeqEMG-GAN, a conditional, sequence-driven generative framework that synthesizes high-fidelity EMG signals from hand joint angle sequences. Our method introduces a context-aware architecture composed of an angle encoder, a dual-layer context encoder featuring the novel Ang2Gist unit, a deep convolutional EMG generator, and a discriminator, all jointly optimized via adversarial learning. By conditioning on joint kinematic trajectories, SeqEMG-GAN is capable of generating semantically consistent EMG sequences, even for previously unseen gestures, thereby enhancing data diversity and physiological plausibility. Experimental results show that classifiers trained solely on synthetic data experience only a slight accuracy drop (from 57.77% to 55.71%). In contrast, training with a combination of real and synthetic data significantly improves accuracy to 60.53%, outperforming real-only training by 2.76%. These findings demonstrate the effectiveness of our framework, also achieves the state-of-art performance in augmenting EMG datasets and enhancing gesture recognition performance for applications such as neural robotic hand control, AI/AR glasses, and gesture-based virtual gaming systems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 15f22597-7cb5-44db-87e7-30c220ca8f3dRelated papers
- SpGesture: Source-Free Domain-adaptive sEMG-based Gesture Recognition with Jaccard Attentive Spiking Neural NetworkWeiyu Guo, Ying Sun, Yijie Xu, Ziyue Qiao et al.NeurIPS 2024 · 17 citations
- EMBridge: Enhancing Gesture Generalization from EMG Signals Through Cross-modal Representation LearningWenhui Cui, Christopher Michael Sandino, Hadi Pouransari, Ran Liu et al.ICLR 2026
- GAN-based Style Transformation to Improve Gesture-recognition AccuracyNoeru Suzuki, Yuki Watanabe, Atsushi NakazawaUbiComp 2021 · 21 citations
- WordGesture-GAN: Modeling Word-Gesture Movement with Generative Adversarial NetworkJeremy Chu, Dongsheng An, Yan Ma, Wenzhe Cui et al.CHI 2023 · 12 citations
- Translating Signals to Languages for sEMG-Based Activity RecognitionMing Wang, Haoxuan Qu, Qiuhong Ke, Wei Zhou et al.CVPR 2026
