MorsEar: Toward Generalizable Low-Resource Covert Messaging via Earable based Inertial Sensing
Garvit Chugh, Indrajeet Ghosh, Nirmalya Roy, Sandip Chakraborty, Suchetana Chakraborty
Abstract
Silent, eyes-free text entry remains challenging when speech and conventional touch input are impractical. Prior wearable systems often required custom sensors or limited users to a small vocabulary. We present MorsEar, an IMU-only earable framework that maps near-ear micro-gestures such as taps for dot/dash; slide/pull/circle for space/delete/send into character-level Morse, enabling unrestricted character composition while using a compact lexicon solely for lightweight on-device autocorrect. The result is a low-bandwidth, reduced-exposure communication channel that works eyes-free and voice-free in accessibility scenarios, silent zones, and constrained environments. MorsEar infers words using a physics-aware preprocessing stack and compact CNN feed a tempo-adaptive segmentation with rolling buffers; an on-device decoder with lightweight autocorrect provides real-time feedback entirely on-phone. In a 24-participant study (with four accessibility users) across Silent, Cafe, and Metro, MorsEar achieved CER 7.3% and WER 12.5% → 7.8% (Autocorrect), with median 9.3/9.1/5.8 WPM, respectively. Similar to other accessibility-oriented encodings such as Braille, Morse requires a brief familiarization period to learn the timing and rhythm of dots and dashes; after which, MorsEar shows that commodity earable IMUs can support discreet, low-exposure text entry that scales beyond discrete commands to language-level interaction.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 226319a2-ccfd-4d09-adf2-18bdc5ec9e45Builds on12
- What Makes for Good Views for Contrastive Learning?Yonglong Tian, Chen Sun, Ben Poole, Dilip Krishnan et al.NeurIPS 2020 · 1,631 citations
- Time Series Contrastive Learning with Information-Aware AugmentationsDongsheng Luo, Wei Cheng, Yingheng Wang, Dongkuan Xu et al.AAAI 2023 · 121 citations
- Assessing the State of Self-Supervised Human Activity Recognition Using WearablesHarish Haresamudram, Irfan Essa, Thomas PlötzUbiComp 2022 · 104 citations
- Sensing with Earables: A Systematic Literature Review and Taxonomy of PhenomenaTobias Röddiger, Christopher Clarke, Paula Breitling, Tim Schneegans et al.UbiComp 2022 · 102 citations
- EarGate: gait-based user identification with in-ear microphonesAndrea Ferlini, Dong Ma, Robert Harle, Cecilia MascoloMobiCom 2021 · 82 citations
Related papers
- ReHEarSSE: Recognizing Hidden-in-the-Ear Silently Spelled ExpressionsXuefu Dong, Yifei Chen, Yuuki Nishiyama, Kaoru Sezaki et al.CHI 2024 · 20 citations
- MuteIt: Jaw Motion Based Unvoiced Command Recognition Using EarableTanmay Srivastava, Prerna Khanna, Shijia Pan, Phuc Nguyen et al.UbiComp 2022 · 52 citations
- TapType: Ten-finger text entry on everyday surfaces via Bayesian inferencePaul Streli, Jiaxi Jiang, Andreas Rene Fender, Manuel Meier et al.CHI 2022 · 48 citations
- Write, Attend and Spell: Streaming End-to-end Free-style Handwriting Recognition Using SmartwatchesQian Zhang, Dong Wang, Run Zhao, Yinggang Yu et al.UbiComp 2021 · 14 citations
- EarCommand: "Hearing" Your Silent Speech Commands In EarYincheng Jin, Yang Gao, Xuhai Xu, Seokmin Choi et al.UbiComp 2022 · 37 citations
