New Synthetic Goldmine: Hand Joint Angle-Driven EMG Data Generation Framework for Micro-Gesture Recognition
Nana Wang, Suli Wang, Gen Li, Pengfei Ren, Hao Su
摘要
Electromyography (EMG)-based gesture recognition has emerged as a promising approach for human-computer interaction. However, its performance is often limited by the scarcity of labeled EMG data, significant cross-user variability, and poor generalization to unseen gestures. To address these challenges, we propose SeqEMG-GAN, a conditional, sequence-driven generative framework that synthesizes high-fidelity EMG signals from hand joint angle sequences. Our method introduces a context-aware architecture composed of an angle encoder, a dual-layer context encoder featuring the novel Ang2Gist unit, a deep convolutional EMG generator, and a discriminator, all jointly optimized via adversarial learning. By conditioning on joint kinematic trajectories, SeqEMG-GAN is capable of generating semantically consistent EMG sequences, even for previously unseen gestures, thereby enhancing data diversity and physiological plausibility. Experimental results show that classifiers trained solely on synthetic data experience only a slight accuracy drop (from 57.77% to 55.71%). In contrast, training with a combination of real and synthetic data significantly improves accuracy to 60.53%, outperforming real-only training by 2.76%. These findings demonstrate the effectiveness of our framework, also achieves the state-of-art performance in augmenting EMG datasets and enhancing gesture recognition performance for applications such as neural robotic hand control, AI/AR glasses, and gesture-based virtual gaming systems.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
相关 Paper
- SpGesture: Source-Free Domain-adaptive sEMG-based Gesture Recognition with Jaccard Attentive Spiking Neural NetworkWeiyu Guo, Ying Sun, Yijie Xu, Ziyue Qiao 等NeurIPS 2024 · 被引用 17 次
- EMBridge: Enhancing Gesture Generalization from EMG Signals Through Cross-modal Representation LearningWenhui Cui, Christopher Michael Sandino, Hadi Pouransari, Ran Liu 等ICLR 2026
- GAN-based Style Transformation to Improve Gesture-recognition AccuracyNoeru Suzuki, Yuki Watanabe, Atsushi NakazawaUbiComp 2021 · 被引用 21 次
- WordGesture-GAN: Modeling Word-Gesture Movement with Generative Adversarial NetworkJeremy Chu, Dongsheng An, Yan Ma, Wenzhe Cui 等CHI 2023 · 被引用 12 次
- Translating Signals to Languages for sEMG-Based Activity RecognitionMing Wang, Haoxuan Qu, Qiuhong Ke, Wei Zhou 等CVPR 2026
