The People's Gaze: Co-Designing and Refining Gaze Gestures with Users and Experts
Yaxiong Lei, Xinya Gong, Shijing He, Yafei Wang, Mohamed Khamis, Juan Ye
Abstract
As eye-tracking becomes increasingly common in modern mobile devices, the potential for hands-free, gaze-based interaction grows, but current gesture sets are largely expert-designed and often misaligned with how users naturally move their eyes. To address this gap, we introduce a two-phase methodology for developing intuitive gaze gestures. First, four co-design workshops with 20 non-expert participants generated 102 initial concepts. Next, four gaze interaction experts reviewed and refined these into a set of 32 gestures. We found that non-experts, after a brief introduction, intuitively anchor gestures in familiar metaphors and develop a compositional grammar; i.e., activation (dwell) + action (gaze gesture or blink), to ensure intentionality and mitigate the classic Midas Touch problem. Experts prioritized gestures that are ergonomically sound, aligned with natural saccades, and reliably distinguishable. The resulting user-grounded, expert-validated gesture set, along with actionable design principles, provides a foundation for developing intuitive, hands-free interfaces for gaze-enabled devices.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8e6bad18-59bf-4285-afb0-2bfd0375d494Builds on6
- Comparing Dwell time, Pursuits and Gaze Gestures for Gaze Interaction on Handheld Mobile DevicesOmar Namnakani, Yasmeen Abdrabou, Jonathan Grizou, Augusto Esteves et al.CHI 2023 · 28 citations
- Lattice Menu: A Low-Error Gaze-Based Marking Menu Utilizing Target-Assisted Gaze Gestures on a Lattice of Visual AnchorsTaejun Kim, Auejin Ham, Sunggeun Ahn, Geehyuk LeeCHI 2022 · 18 citations
- Iterative Design of Gestures During Elicitation: Understanding the Role of Increased ProductionAndreea Danielescu, David PiorkowskiCHI 2022 · 18 citations
- TwinkleTwinkle: Interacting with Your Smart Devices by Eye BlinkHaiming Cheng, Wei Lou, Yanni Yang, Yi-pu Chen et al.UbiComp 2023 · 13 citations
- Stretch Gaze Targets Out: Experimenting with Target Sizes for Gaze-Enabled Interfaces on Mobile DevicesOmar Namnakani, Yasmeen Abdrabou, Jonathan Grizou, Mohamed KhamisCHI 2025 · 4 citations
Related papers
- EyeGesener: Eye Gesture Listener for Smart Glasses Interaction Using Acoustic SensingTao Sun, Yankai Zhao, Wentao Xie, Jiao Li et al.UbiComp 2024 · 15 citations
- "I Don't Want People to Look At Me Differently": Designing User-Defined Above-the-Neck Gestures for People with Upper Body Motor ImpairmentsXuan Zhao, Mingming Fan, Teng HanCHI 2022 · 11 citations
- Seeing and Touching the Air: Unraveling Eye-Hand Coordination in Mid-Air Gesture Typing for Mixed RealityJinghui Hu, John J. Dudley, Per Ola KristenssonCHI 2025 · 3 citations
- Reimagining Wearable AR Gesture Design: Physical Therapy Reasoning in Everyday ContextsWei Wu, Binyan Xu, Soonhyeon Kweon, Yujie Wang et al.CHI 2026 · 1 citation
- Classifying Head Movements to Separate Head-Gaze and Head Gestures as Distinct Modes of InputBaosheng James Hou, Joshua Newn, Ludwig Sidenmark, Anam Ahmad Khan et al.CHI 2023 · 18 citations
