Telling Us What You Experience: Effects of Questionnaire Interface Design on Subjective Measurements in Virtual Reality
Lucas Küntzer, Martin Feick, Max Benzschawel, Naz Al Kassm, Tilo Mentler, Heike Spaderna, Robert J. Teather, Georg Rock
Abstract
Virtual reality (VR) enables immersive, tightly controlled experiments but complicates subjective measurement: moving participants out of the virtual environment (VE) to complete questionnaires changes the measurement context and can increase recall bias. Questionnaires embedded in the VE enable immediate, time-efficient self-reports and repeated sampling, yet adoption is limited by concerns that might bias primary experiential measures and by the implementation burden of usable interfaces. In this within-subject study, 43 participants completed post-task questionnaires using three representative 2D interface designs: a body-anchored watch (direct touch), a world-anchored station (handheld pointer), and a world-anchored board at 5 m (laser pointer). Usability and task load differed significantly across interfaces, revealing clear design trade-offs. Interview feedback highlighted corresponding ergonomic themes. In contrast, ratings of presence and flow related to the constant task and VE showed no practically relevant differences across interfaces, supported by equivalence tests. Findings suggest that once basic usability requirements are met, interface choice is unlikely to meaningfully bias experiential measures in similar setups. This study contributes methodological guidance for implementing or selecting tools to improve VR study quality, comparability, and reproducibility. Supplemental materials are available at osf.io/528yk (CC BY 4.0).
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 4fc7d810-b70c-44c1-a70f-fa8f6411f7b5Related papers
- Examining Design Choices of Questionnaires in VR User StudiesDmitry Alexandrovsky, Susanne Putze, Michael Bonfert, Sebastian Höffner et al.CHI 2020 · 80 citations
- Breaking The Experience: Effects of Questionnaires in VR User StudiesSusanne Putze, Dmitry Alexandrovsky, Felix Putze, Sebastian Höffner et al.CHI 2020 · 135 citations
- Answering With Bow and Arrow: Questionnaires and VR Blend Without Distorting the OutcomeJan P. Gründling, Daniel Zeiler, Benjamin WeyersIEEE VR 2022 · 8 citations
- When Do We Feel Present in a Virtual Reality? Towards Sensitivity and User Acceptance of Presence QuestionnairesAnnalisa Degenhard, Ali Askari, Michael Rietzler, Enrico RukzioCHI 2025 · 6 citations
- Investigating Spatial Representation of Learning Content in Virtual Reality Learning EnvironmentsManshul Belani, Harsh Vardhan Singh, Aman Parnami, Pushpendra SinghIEEE VR 2023 · 11 citations
