MorsEar: Toward Generalizable Low-Resource Covert Messaging via Earable based Inertial Sensing
Garvit Chugh, Indrajeet Ghosh, Nirmalya Roy, Sandip Chakraborty, Suchetana Chakraborty
摘要
Silent, eyes-free text entry remains challenging when speech and conventional touch input are impractical. Prior wearable systems often required custom sensors or limited users to a small vocabulary. We present MorsEar, an IMU-only earable framework that maps near-ear micro-gestures such as taps for dot/dash; slide/pull/circle for space/delete/send into character-level Morse, enabling unrestricted character composition while using a compact lexicon solely for lightweight on-device autocorrect. The result is a low-bandwidth, reduced-exposure communication channel that works eyes-free and voice-free in accessibility scenarios, silent zones, and constrained environments. MorsEar infers words using a physics-aware preprocessing stack and compact CNN feed a tempo-adaptive segmentation with rolling buffers; an on-device decoder with lightweight autocorrect provides real-time feedback entirely on-phone. In a 24-participant study (with four accessibility users) across Silent, Cafe, and Metro, MorsEar achieved CER 7.3% and WER 12.5% → 7.8% (Autocorrect), with median 9.3/9.1/5.8 WPM, respectively. Similar to other accessibility-oriented encodings such as Braille, Morse requires a brief familiarization period to learn the timing and rhythm of dots and dashes; after which, MorsEar shows that commodity earable IMUs can support discreet, low-exposure text entry that scales beyond discrete commands to language-level interaction.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper12
- What Makes for Good Views for Contrastive Learning?Yonglong Tian, Chen Sun, Ben Poole, Dilip Krishnan 等NeurIPS 2020 · 被引用 1,631 次
- Time Series Contrastive Learning with Information-Aware AugmentationsDongsheng Luo, Wei Cheng, Yingheng Wang, Dongkuan Xu 等AAAI 2023 · 被引用 121 次
- Assessing the State of Self-Supervised Human Activity Recognition Using WearablesHarish Haresamudram, Irfan Essa, Thomas PlötzUbiComp 2022 · 被引用 104 次
- Sensing with Earables: A Systematic Literature Review and Taxonomy of PhenomenaTobias Röddiger, Christopher Clarke, Paula Breitling, Tim Schneegans 等UbiComp 2022 · 被引用 102 次
- EarGate: gait-based user identification with in-ear microphonesAndrea Ferlini, Dong Ma, Robert Harle, Cecilia MascoloMobiCom 2021 · 被引用 82 次
相关 Paper
- ReHEarSSE: Recognizing Hidden-in-the-Ear Silently Spelled ExpressionsXuefu Dong, Yifei Chen, Yuuki Nishiyama, Kaoru Sezaki 等CHI 2024 · 被引用 20 次
- MuteIt: Jaw Motion Based Unvoiced Command Recognition Using EarableTanmay Srivastava, Prerna Khanna, Shijia Pan, Phuc Nguyen 等UbiComp 2022 · 被引用 52 次
- TapType: Ten-finger text entry on everyday surfaces via Bayesian inferencePaul Streli, Jiaxi Jiang, Andreas Rene Fender, Manuel Meier 等CHI 2022 · 被引用 48 次
- Write, Attend and Spell: Streaming End-to-end Free-style Handwriting Recognition Using SmartwatchesQian Zhang, Dong Wang, Run Zhao, Yinggang Yu 等UbiComp 2021 · 被引用 14 次
- EarCommand: "Hearing" Your Silent Speech Commands In EarYincheng Jin, Yang Gao, Xuhai Xu, Seokmin Choi 等UbiComp 2022 · 被引用 37 次
