Anticipation Before Action: EEG-Based Implicit Intent Detection for Adaptive Gaze Interaction in Mixed Reality
Francesco Chiossi, Elnur Imamaliyev, Martin Bleichner, Sven Mayer
Abstract
Mixed Reality (MR) interfaces increasingly rely on gaze for interaction, yet distinguishing visual attention from intentional action remains difficult, leading to the Midas Touch problem. Existing solutions require explicit confirmations, while brain-computer interfaces may provide an implicit marker of intention using Stimulus-Preceding Negativity (SPN). We investigated how Intention (Select vs. Observe) and Feedback (With vs. Without) modulate SPN during gaze-based MR interactions. During realistic selection tasks, we acquired EEG and eye-tracking data from 28 participants. SPN was robustly elicited and sensitive to both factors: observation without feedback produced the strongest amplitudes, while intention to select and expectation of feedback reduced activity, suggesting SPN reflects anticipatory uncertainty rather than motor preparation. Complementary decoding with deep learning models achieved reliable person-dependent classification of user intention, with accuracies ranging from 75% to 97% across participants. These findings identify SPN as an implicit marker for building intention-aware MR interfaces that mitigate the Midas Touch.
• Human-centered computing → Human computer interaction (HCI).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on10
- A Fitts' Law Study of Gaze-Hand Alignment for Selection in 3D User InterfacesUta Wagner, Mathias N. Lystbæk, Pavel Manakhov, Jens Emil Sloth Grønbæk et al.CHI 2023 · 93 citations
- iText: Hands-free Text Entry on an Imaginary Keyboard for Augmented Reality SystemsXueshi Lu, Difeng Yu, Hai-Ning Liang, Jorge GonçalvesUIST 2021 · 54 citations
- HeadCross: Exploring Head-Based Crossing Selection on Head-Mounted DisplaysYukang Yan, Yingtian Shi, Chun Yu, Yuanchun ShiUbiComp 2020 · 46 citations
- Pose-on-the-Go: Approximating User Pose with Smartphone Sensor Fusion and Inverse KinematicsKaran Ahuja, Sven Mayer, Mayank Goel, Chris HarrisonCHI 2021 · 40 citations
- Head-Coupled Kinematic Template Matching: A Prediction Model for Ray Pointing in VRRorik Henrikson, Tovi Grossman, Sean Trowbridge, Daniel Wigdor et al.CHI 2020 · 36 citations
Related papers
- Towards an Eye-Brain-Computer Interface: Combining Gaze with the Stimulus-Preceding Negativity for Target Selections in XRG. S. Rajshekar Reddy, Michael J. Proulx, Leanne M. Hirshfield, Anthony J. RiesCHI 2024 · 13 citations
- The Brain Knows What You Prefer: Using EEG to Decode AR Input PreferencesKaining Zhang, Theophilus Teo, Eunhee Chang, Xianglin Zheng et al.CHI 2025 · 2 citations
- A Multimodal Approach for Targeting Error Detection in Virtual Reality Using Implicit User BehaviorNaveen Sendhilnathan, Ting Zhang, David Bethge, Michael Nebeling et al.CHI 2025 · 3 citations
- Dwell Selection with ML-based Intent Prediction Using Only Gaze DataToshiya Isomoto, Shota Yamanaka, Buntarou ShizukiUbiComp 2022 · 33 citations
- RIDS: Implicit Detection of a Selection Gesture Using Hand Motion Dynamics During Freehand Pointing in Virtual RealityTing Zhang, Zhenhong Hu, Aakar Gupta, Chi-Hao Wu et al.UIST 2022 · 9 citations
