Toward Multimodal Privacy in XR: Design and Evaluation of Composite Privatization Methods for Gaze and Body Tracking Data
Azim Ibragimov, Ethan Wilson, Kevin R. B. Butler, Eakta Jain
摘要
As extended reality (XR) systems become increasingly immersive and sensor-rich, they enable the collection of behavioral signals such as eye and body telemetry. These signals support personalized and responsive experiences and may also contain unique patterns that can be linked back to individuals. However, privacy mechanisms that naively pair unimodal mechanisms (e.g., independently apply privacy mechanisms for eye and body privatization) are often ineffective at preventing re-identification in practice. In this work, we systematically evaluate real-time privacy mechanisms for XR, both individually and in pair, across eye and body modalities. We assess privacy through re-identification rates and evaluate utility using numerical performance thresholds derived from existing literature to ensure real-time interaction requirements are met. We evaluated four eye and ten body mechanisms across multiple datasets, comprising up to 407 participants. Our results show that when carefully paired, multimodal mechanisms reduce re-identification rate from 80.3% to 26.3% in casual XR applications (e.g., VRChat and Job Simulator) and from 84.8% to 26.1 % in competitive XR applications (e.g., Beat Saber and Synth Riders), all while maintaining acceptable performance based on established thresholds. To facilitate adoption, we additionally release XR Privacy SDK, an open-source toolkit enabling developers to integrate the privacy mechanisms into XR applications for real-time use. These findings underscore the potential of modality-specific and context-aware privacy strategies for protecting behavioral data in XR environments.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper11
- Hands-free interaction in immersive virtual reality: A systematic reviewPedro Monteiro, Guilherme Gonçalves, Hugo Coelho, Miguel Melo 等IEEE VR 2021 · 被引用 116 次
- A privacy-preserving approach to streaming eye-tracking dataBrendan David-John, Diane Hosfelt, Kevin R. B. Butler, Eakta JainIEEE VR 2021 · 被引用 89 次
- Leveling the Playing Field: A Comparative Reevaluation of Unmodified Eye Tracking as an Input and Interaction Modality for VRAjoy Savio Fernandes, T. Scott Murdison, Michael J. ProulxIEEE VR 2023 · 被引用 69 次
- Improving Virtual Reality Ergonomics Through Reach-Bounded Non-Linear Input AmplificationJohann Wentzel, Greg d'Eon, Daniel VogelCHI 2020 · 被引用 68 次
- Privacy Research with Marginalized Groups: What We Know, What's Needed, and What's NextShruti Sannon, Andrea ForteCSCW 2022 · 被引用 66 次
相关 Paper
- Privacy-Preserving Gaze Data Streaming in Immersive Interactive Virtual Reality: Robustness and User ExperienceEthan Wilson, Azim Ibragimov, Michael J. Proulx, Sai Deep Tetali 等IEEE VR 2024 · 被引用 30 次
- Exploring the Uncoordinated Privacy Protections of Eye Tracking and VR Motion Data for Unauthorized User IdentificationSamantha Aziz, Oleg KomogortsevIEEE VR 2025 · 被引用 4 次
- Privacy-preserving datasets of eye-tracking samples with applications in XRBrendan David-John, Kevin R. B. Butler, Eakta JainIEEE VR 2023 · 被引用 35 次
- Privacy in Immersive Extended Reality: Exploring User Perceptions, Concerns, and Coping StrategiesHilda Hadan, Derrick M. Wang, Lennart E. Nacke, Leah Zhang-KennedyCHI 2024 · 被引用 36 次
- CHOP: Breaking Anonymity in XR through a Novel and Cost-effective Chain of Privacy Attacks and Differential Privacy-Based DefensesRipan Kumar Kundu, Brendan David-John, Khaza Anuarul HoqueIEEE VR 2026
