GraspR: A Computational Model of Spatial User Preferences for Adaptive Grasp UI Design
Arthur Caetano, Yunhao Luo, Adwait Sharma, Misha Sra
Abstract
Grasp User Interfaces (grasp UIs) enable dual-tasking in XR by allowing interaction with digital content while holding physical objects. However, current grasp UI design practices face a fundamental challenge: existing approaches either capture user preferences through labor-intensive elicitation studies that are difficult to scale or rely on biomechanical models that overlook subjective factors. We introduce GraspR, the first computational model that predicts user preferences for single-finger microgestures in grasp UIs. Our data-driven approach combines the scalability of computational methods with human preference modeling, trained on 1,520 preferences collected via a two-alternative forced choice paradigm across eight participants and four frequently used grasp variations. We demonstrate GraspR's effectiveness through a working prototype that dynamically adjusts interface layouts across four everyday tasks. We release both the dataset and code to support future research in adaptive grasp UIs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f3bee5b2-cd4f-41ed-9706-eb31423037f7Builds on18
- XRgonomics: Facilitating the Creation of Ergonomic 3D InterfacesJoão Marcelo Evangelista Belo, Anna Maria Feit, Tiare M. Feuchtner, Kaj GrønbækCHI 2021 · 138 citations
- AUIT - the Adaptive User Interfaces Toolkit for Designing XR ApplicationsJoão Marcelo Evangelista Belo, Mathias N. Lystbæk, Anna Maria Feit, Ken Pfeuffer et al.UIST 2022 · 114 citations
- AdapTutAR: An Adaptive Tutoring System for Machine Tasks in Augmented RealityGaoping Huang, Xun Qian, Tianyi Wang, Fagun Patel et al.CHI 2021 · 93 citations
- Gripmarks: Using Hand Grips to Transform In-Hand Objects into Mixed Reality InputQian Zhou, Sarah Sykes, Sidney S. Fels, Kenrick KinCHI 2020 · 44 citations
- SoloFinger: Robust Microgestures while Grasping Everyday ObjectsAdwait Sharma, Michael A. Hedderich, Divyanshu Bhardwaj, Bruno Fruchard et al.CHI 2021 · 37 citations
Related papers
- Grip-Reach-Touch-Repeat: A Refined Model of Grasp to Encompass One-Handed Interaction with Arbitrary Form Factor DevicesKaixing Zhao, Chaoyi Wu, Tao Xu, Liang He et al.CHI 2024 · 3 citations
- MineXR: Mining Personalized Extended Reality InterfacesHyunsung Cho, Yukang Yan, Kashyap Todi, Mark Parent et al.CHI 2024 · 22 citations
- Freehand Grasping: An Analysis of Grasping for Docking Tasks in Virtual RealityAndreea-Dalia Blaga, Maite Frutos-Pascual, Chris Creed, Ian WilliamsIEEE VR 2021 · 18 citations
- Hands-on, Hands-off: Gaze-Assisted Bimanual 3D InteractionMathias N. Lystbæk, Thorbjørn Mikkelsen, Roland Krisztandl, Eric J. Gonzalez et al.UIST 2024 · 21 citations
- Preference-Guided Multi-Objective UI AdaptationYao Song, Christoph Gebhardt, Yi-Chi Liao, Christian HolzUIST 2025 · 3 citations
