USENIX Security2023Top-tier venue
Unique Identification of 50, 000+ Virtual Reality Users from Head & Hand Motion Data
Vivek Nair, Wenbo Guo, Justus Mattern, Rui Wang, James F. O'Brien, Louis B. Rosenberg, Dawn Song
Abstract
With the recent explosive growth of interest and investment in virtual reality (VR) and the so-called"metaverse,"public attention has rightly shifted toward the unique security and privacy threats that these platforms may pose. While it has long been known that people reveal information about themselves via their motion, the extent to which this makes an individual globally identifiable within virtual reality has not yet been widely understood. In this study, we show that a large number of real VR users (N=55,541) can be uniquely and reliably identified across multiple sessions using just their head and hand motion relative to virtual objects. After training a classification model on 5 minutes of data per person, a user can be uniquely identified amongst the entire pool of 50,000+ with 94.33% accuracy from 100 seconds of motion, and with 73.20% accuracy from just 10 seconds of motion. This work is the first to truly demonstrate the extent to which biomechanics may serve as a unique identifier in VR, on par with widely used biometrics such as facial or fingerprint recognition.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers22
- Going Incognito in the Metaverse: Achieving Theoretically Optimal Privacy-Usability Tradeoffs in VRVivek C. Nair, Gonzalo Munilla Garrido, Dawn SongUIST 2023 · 54 citations
- When the User Is Inside the User Interface: An Empirical Study of UI Security Properties in Augmented RealityKaiming Cheng, Arkaprabha Bhattacharya, Michelle Lin, Jaewook Lee et al.USENIX Security 2024 · 29 citations
- That Doesn't Go There: Attacks on Shared State in Multi-User Augmented Reality ApplicationsCarter Slocum, Yicheng Zhang, Erfan Shayegani, Pedram Zaree et al.USENIX Security 2024 · 21 citations
- What You Experience is What We Collect: User Experience Based Fine-Grained Permissions for Everyday Augmented RealityMelvin Abraham, Mark McGill, Mohamed KhamisCHI 2024 · 18 citations
- Berkeley Open Extended Reality Recordings 2023 (BOXRR-23): 4.7 Million Motion Capture Recordings from 105,000 XR UsersVivek Nair, Wenbo Guo, Rui Wang, James F. O'Brien et al.IEEE VR 2024 · 17 citations
Builds on1
Related papers
- Kinetic Signatures: A Systematic Investigation of Movement-Based User Identification in Virtual RealityJonathan Liebers, Patrick Laskowski, Florian Rademaker, Leon Sabel et al.CHI 2024 · 19 citations
- Combining Real-World Constraints on User Behavior with Deep Neural Networks for Virtual Reality (VR) BiometricsRobert Miller, Natasha Kholgade Banerjee, Sean BanerjeeIEEE VR 2022 · 41 citations
- When VR Meets BCI: (Un)Observable Brainwave-Aware Privacy Reconstruction in the Metaverse via Unrestricted Inbuilt Motion SensorsTao Ni, Zehua Sun, Qingchuan Zhao, Wei-Bin Lee et al.S&P 2026
- Exploring the Uncoordinated Privacy Protections of Eye Tracking and VR Motion Data for Unauthorized User IdentificationSamantha Aziz, Oleg KomogortsevIEEE VR 2025 · 4 citations
- Temporal Effects in Motion Behavior for Virtual Reality (VR) BiometricsRobert Miller, Natasha Kholgade Banerjee, Sean BanerjeeIEEE VR 2022 · 36 citations
