Empowered XR through Generative AI: Balancing Superpowers and Risks
Yiliu Tang, Mengke Wu, Jason Situ, Jingyi Liu, Andrea Yaoyun Cui, Yun Huang
Abstract
The integration of generative AI with Extended Reality (XR) technologies has unlocked unprecedented capabilities, empowering users with enhanced cognitive, sensory, and environmental control – effectively enabling "superpowers" in immersive digital spaces. This paper explores both the benefits and potential risks. We make two contributions: (i) a synthesized taxonomy of LLM-enabled XR superpowers and their associated risks, and (ii) a set of design guidelines and a forward research agenda derived from that synthesis. We conduct a multi-phase analysis of 135 recent advancements and studies in the field to examine the superpowers granted by these technologies, alongside their associated risks. We categorize the superpowers into internal (cognitive and sensory enhancements) and external (environmental and social manipulations), illustrating how they amplify human abilities in domains such as healthcare, education, and professional training. We then analyze the risks specific to each superpower, revealing critical vulnerabilities in user autonomy, data security, and ethical transparency. This research aims to guide stakeholders in harnessing the potential of XR while mitigating the socio-technical risks of this emerging landscape.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Related papers
- LLM Integration in Extended Reality: A Comprehensive Review of Current Trends, Challenges, and Future PerspectivesYiliu Tang, Jason Situ, Andrea Yaoyun Cui, Mengke Wu et al.CHI 2025 · 37 citations
- When XR and AI Meet - A Scoping Review on Extended Reality and Artificial IntelligenceTeresa Hirzle, Florian Müller, Fiona Draxler, Martin Schmitz et al.CHI 2023 · 90 citations
- Malicious LLM-Based Conversational AI Makes Users Reveal Personal InformationXiao Zhan, Juan Carlos Carrillo, William Seymour, Jose SuchUSENIX Security 2025
- JARVIS or Ultron? A Survey on the Safety and Security Threats of Computer-Using AgentsAda Chen, Yongjiang Wu, Junyuan Zhang, Jingyu Xiao et al.ACL 2026 · 24 citations
- GestuProp: 3D Virtual Reality Prop Generation with Co-Speech GesturesZhihao Yao, Xiwen Yao, Haowei Xiong, Yuan-Ling Feng et al.CHI 2026 · 1 citation
