PinchCatcher: Enabling Multi-selection for Gaze+Pinch
Jinwook Kim, Sangmin Park, Qiushi Zhou, Mar González-Franco, Jeongmi Lee, Ken Pfeuffer
Abstract
This paper investigates multi-selection in XR interfaces based on eye and hand interaction. We propose enabling multi-selection using different variations of techniques that combine gaze with a semi-pinch gesture, allowing users to select multiple objects, while on the way to a full-pinch. While our exploration is based on the semi-pinch mode for activating a quasi-mode, we explore four methods for confirming subselections in multi-selection mode, varying in effort and complexity: dwell-time (SemiDwell), swipe (SemiSwipe), tilt (SemiTilt), and non-dominant hand input (SemiNDH), and compare them to a baseline technique. In the user study, we evaluate their effectiveness in reducing task completion time, errors, and effort. The results indicate the strengths and weaknesses of each technique, with SemiSwipe and SemiDwell as the most preferred methods by participants. We also demonstrate their utility in file managing and RTS gaming application scenarios. This study provides valuable insights to advance 3D input systems in XR.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 682b2b5b-50d1-4a33-bd84-a7660de1ace3Cited by top-tier papers6
- Anticipation Before Action: EEG-Based Implicit Intent Detection for Adaptive Gaze Interaction in Mixed RealityFrancesco Chiossi, Elnur Imamaliyev, Martin Bleichner, Sven MayerCHI 2026 · 3 citations
- ForcePinch: Force-Responsive Spatial Interaction for Tracking Speed Control in XRChenyang Zhang, Tiffany S. Ma, John Andrews, Eric J. Gonzalez et al.UIST 2025 · 3 citations
- Reality Proxy: Fluid Interactions with Real-World Objects in MR via Abstract RepresentationsXiaoan Liu, Difan Jia, Xianhao Carton Liu, Mar González-Franco et al.UIST 2025 · 2 citations
- Eyes on Many: Evaluating Gaze, Hand, and Voice for Multi-Object Selection in Extended RealityMohammad Raihanul Bashar, Aunnoy K. Mutasim, Ken Pfeuffer, Anil Ufuk BatmazCHI 2026 · 1 citation
- SwEYEpinch and Beyond: Exploring Intuitive, Efficient Text Entry for Extended Reality via Eye and Hand TrackingZiheng 'Leo' Li, Xichen He, Mengyuan Wu, Zeyi Tong et al.CHI 2026 · 1 citation
Builds on11
- How to Evaluate Object Selection and Manipulation in VR? Guidelines from 20 Years of StudiesJoanna Bergström, Tor-Salve Dalsgaard, Jason Alexander, Kasper HornbækCHI 2021 · 116 citations
- A Fitts' Law Study of Gaze-Hand Alignment for Selection in 3D User InterfacesUta Wagner, Mathias N. Lystbæk, Pavel Manakhov, Jens Emil Sloth Grønbæk et al.CHI 2023 · 93 citations
- Understanding the Heisenberg Effect of Spatial Interaction: A Selection Induced Error for Spatially Tracked Input DevicesDennis Wolf, Jan Gugenheimer, Marco Combosch, Enrico RukzioCHI 2020 · 73 citations
- InteractionAdapt: Interaction-driven Workspace Adaptation for Situated Virtual Reality EnvironmentsYi Fei Cheng, Christoph Gebhardt, Christian HolzUIST 2023 · 44 citations
- Vergence Matching: Inferring Attention to Objects in 3D Environments for Gaze-Assisted SelectionLudwig Sidenmark, Christopher Clarke, Joshua Newn, Mathias N. Lystbæk et al.CHI 2023 · 29 citations
Related papers
- Hands-on, Hands-off: Gaze-Assisted Bimanual 3D InteractionMathias N. Lystbæk, Thorbjørn Mikkelsen, Roland Krisztandl, Eric J. Gonzalez et al.UIST 2024 · 21 citations
- Eye-Hand Movement of Objects in Near Space Extended RealityUta Wagner, Andreas Asferg Jacobsen, Tiare Feuchtner, Hans Gellersen et al.UIST 2024 · 16 citations
- GazePuffer: Hands-Free Input Method Leveraging Puff Cheeks for VRYunfei Lai, Minghui Sun, Zhuofeng LiIEEE VR 2024 · 8 citations
- A Comparative Analysis of 3D User Interaction: How to Move Virtual Objects in Mixed RealityHyo Jeong Kang, Jung-Hye Shin, Kevin PontoIEEE VR 2020 · 78 citations
- GazeZoom: Exploration of Gaze-Assisted Multimodal Techniques for Panning and ZoomingYilong Lin, Mingyu Han, Weitao Jiang, Seungwoo Je et al.CHI 2026 · 1 citation
