Lune

CHI2023Top-tier venue

LipIO: Enabling Lips as both Input and Output Surface

Arata Jingu, Yudai Tanaka, Pedro Lopes

Abstract

Abstract. We engineered LipIO, a novel device enabling the lips to be used simultaneously as an input and output surface. LipIO comprises two overlapping flexible electrode arrays: an outward-facing array for capacitive touch and a lip-facing array for electrotactile stimulation. While wearing LipIO, users feel the interface's state via lip stimulation and respond by touching their lip with their tongue or opposing lip. More importantly, LipIO provides co-located tactile feedback that allows users to feel where in the lip they are touching—this is key to enabling eyes- and hands-free interactions. Our three studies verified participants perceived electrotactile output on their lips and subsequently touched the target location with their tongue with an average accuracy of 93%, while wearing LipIO with five I/O electrodes with co-located feedback. Finally, we demonstrate the potential of LipIO in four exemplary applications that illustrate how it enables new types of eyes- and hands-free micro-interactions.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

5 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • LipNotif: Use of Lips as a Non-Contact Tactile Notification Interface Based on Ultrasonic Tactile Presentation cites FaceHaptics: Robot Arm based Versatile Facial Haptics for Immersive Environments
  • Increasing Input Accuracy of Embodied Devices via Electrical Muscle Stimulation cites FeetThrough: Electrotactile Foot Interface that Preserves Real-World Sensations
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers5

  1. FeetThrough: Electrotactile Foot Interface that Preserves Real-World SensationsKeigo Ushiyama, Pedro LopesUIST 2023 · 28 citations
  2. Sensible Agent: A Framework for Unobtrusive Interaction with Proactive AR AgentsGeonsun Lee, Min Xia, Nels Numan, Xun Qian et al.UIST 2025 · 15 citations
  3. MouthIO: Fabricating Customizable Oral User Interfaces with Integrated Sensing and ActuationYijing Jiang, Julia Kleinau, Till Max Eckroth, Eve E. Hoggan et al.UIST 2024 · 4 citations
  4. InterFACE: Establishing a Facial Action Unit Input Vocabulary for Hands-Free Extended Reality Interactions, From VR Gaming to AR Web BrowsingGraham A. Wilson, Jamie McCready, Euan Freeman, Florian Mathis et al.CHI 2025 · 3 citations
  5. Increasing Input Accuracy of Embodied Devices via Electrical Muscle StimulationLonnie Chien, Yudai Tanaka, Noor Amin, Jas Brooks et al.CHI 2026 · 1 citation

Builds on6

  1. Mouth Haptics in VR using a Headset Ultrasound Phased ArrayVivian Shen, Craig D. Shultz, Chris HarrisonCHI 2022 · 62 citations
  2. Stereo-Smell via Electrical Trigeminal StimulationJas Brooks, Shan-Yuan Teng, Jingxuan Wen, Romain Nith et al.CHI 2021 · 59 citations
  3. FaceHaptics: Robot Arm based Versatile Facial Haptics for Immersive EnvironmentsAlexander Wilberz, Dominik Leschtschow, Christina Trepkowski, Jens Maiero et al.CHI 2020 · 54 citations
  4. BodyPrinter: Fabricating Circuits Directly on the Skin at Arbitrary Locations Using a Wearable Compact PlotterYoungkyung Choi, Neung Ryu, Myung Jin Kim, Artem Dementyev et al.UIST 2020 · 29 citations
  5. LipNotif: Use of Lips as a Non-Contact Tactile Notification Interface Based on Ultrasonic Tactile PresentationArata Jingu, Takaaki Kamigaki, Masahiro Fujiwara, Yasutoshi Makino et al.UIST 2021 · 18 citations

Related papers

  1. TactTongue: Prototyping ElectroTactile Stimulations on the TongueDinmukhammed Mukashev, Nimesha Ranasinghe, Aditya Shekhar NittalaUIST 2023 · 19 citations
  2. Double-Sided Tactile Interactions for Grasping in Virtual RealityArata Jingu, Anusha Withana, Jürgen SteimleUIST 2023 · 12 citations
  3. RElectrode: A Reconfigurable Electrode For Multi-Purpose Sensing Based on MicrofluidicsWei Sun, Yanjun Chen, Simon Zhan, Teng Han et al.CHI 2021 · 9 citations
  4. Lipwatch: Enabling Silent Speech Recognition on Smartwatches using Acoustic SensingQian Zhang, Yubin Lan, Kaiyi Guo, Dong WangUbiComp 2024 · 20 citations
  5. Designing and Evaluating Hand-to-Hand Gestures with Dual Commodity Wrist-Worn DevicesYiqin Lu, Bingjian Huang, Chun Yu, Guahong Liu et al.UbiComp 2020 · 37 citations
Dusk over the sea between two cliffs drawn in fine vertical lines