Acceptability of Speech and Silent Speech Input Methods in Private and Public
Laxmi Pandey, Khalad Hasan, Ahmed Sabbir Arif
Abstract
Silent speech input converts non-acoustic features like tongue and lip movements into text. It has been demonstrated as a promising input method on mobile devices and has been explored for a variety of audiences and contexts where the acoustic signal is unavailable (e.g., people with speech disorders) or unreliable (e.g., noisy environment). Though the method shows promise, very little is known about peoples’ perceptions regarding using it. In this work, first, we conduct two user studies to explore users’ attitudes towards the method with a particular focus on social acceptance and error tolerance. Results show that people perceive silent speech as more socially acceptable than speech input and are willing to tolerate more errors with it to uphold privacy and security. We then conduct a third study to identify a suitable method for providing real-time feedback on silent speech input. Results show users find an abstract feedback method effective and significantly more private and secure than a commonly used video feedback method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d0ed5091-99a7-40a4-a179-f6e73f61332cCited by top-tier papers7
- mSilent: Towards General Corpus Silent Speech Recognition Using COTS mmWave RadarShang Zeng, Haoran Wan, Shuyu Shi, Wei WangUbiComp 2023 · 34 citations
- To Err is AI: Imperfect Interventions and Repair in a Conversational Agent Facilitating Group Chat DiscussionsHyo Jin Do, Ha Kyung Kong, Pooja Tetali, Jaewook Lee et al.CSCW 2023 · 31 citations
- MELDER: The Design and Evaluation of a Real-time Silent Speech Recognizer for Mobile DevicesLaxmi Pandey, Ahmed Sabbir ArifCHI 2024 · 14 citations
- Crownboard: A One-Finger Crown-Based Smartwatch Keyboard for Users with Limited DexterityGulnar Rakhmetulla, Ahmed Sabbir ArifCHI 2023 · 12 citations
- FingerGlass: Enhancing Smart Glasses Interaction via Fingerprint SensingZhanwei Xu, Haoxiang Pei, Jianjiang Feng, Jie ZhouCHI 2025 · 4 citations
Builds on1
Related papers
- EchoWhisper: Exploring an Acoustic-based Silent Speech Interface for Smartphone UsersYang Gao, Yincheng Jin, Jiyang Li, Seokmin Choi et al.UbiComp 2020 · 44 citations
- Speech Reconstruction from Silent Lip and Tongue Articulation by Diffusion Models and Text-Guided Pseudo Target GenerationRui-Chen Zheng, Yang Ai, Zhen-Hua LingACM MM 2024
- Lipwatch: Enabling Silent Speech Recognition on Smartwatches using Acoustic SensingQian Zhang, Yubin Lan, Kaiyi Guo, Dong WangUbiComp 2024 · 20 citations
- Watch Your Mouth: Silent Speech Recognition with Depth SensingXue Wang, Zixiong Su, Jun Rekimoto, Yang ZhangCHI 2024 · 19 citations
- SoundLip: Enabling Word and Sentence-level Lip Interaction for Smart DevicesQian Zhang, Dong Wang, Run Zhao, Yinggang YuUbiComp 2021 · 34 citations
