Empowered XR through Generative AI: Balancing Superpowers and Risks
Yiliu Tang, Mengke Wu, Jason Situ, Jingyi Liu, Andrea Yaoyun Cui, Yun Huang
摘要
The integration of generative AI with Extended Reality (XR) technologies has unlocked unprecedented capabilities, empowering users with enhanced cognitive, sensory, and environmental control – effectively enabling "superpowers" in immersive digital spaces. This paper explores both the benefits and potential risks. We make two contributions: (i) a synthesized taxonomy of LLM-enabled XR superpowers and their associated risks, and (ii) a set of design guidelines and a forward research agenda derived from that synthesis. We conduct a multi-phase analysis of 135 recent advancements and studies in the field to examine the superpowers granted by these technologies, alongside their associated risks. We categorize the superpowers into internal (cognitive and sensory enhancements) and external (environmental and social manipulations), illustrating how they amplify human abilities in domains such as healthcare, education, and professional training. We then analyze the risks specific to each superpower, revealing critical vulnerabilities in user autonomy, data security, and ethical transparency. This research aims to guide stakeholders in harnessing the potential of XR while mitigating the socio-technical risks of this emerging landscape.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- LLM Integration in Extended Reality: A Comprehensive Review of Current Trends, Challenges, and Future PerspectivesYiliu Tang, Jason Situ, Andrea Yaoyun Cui, Mengke Wu 等CHI 2025 · 被引用 37 次
- When XR and AI Meet - A Scoping Review on Extended Reality and Artificial IntelligenceTeresa Hirzle, Florian Müller, Fiona Draxler, Martin Schmitz 等CHI 2023 · 被引用 90 次
- Malicious LLM-Based Conversational AI Makes Users Reveal Personal InformationXiao Zhan, Juan Carlos Carrillo, William Seymour, Jose SuchUSENIX Security 2025
- JARVIS or Ultron? A Survey on the Safety and Security Threats of Computer-Using AgentsAda Chen, Yongjiang Wu, Junyuan Zhang, Jingyu Xiao 等ACL 2026 · 被引用 24 次
- GestuProp: 3D Virtual Reality Prop Generation with Co-Speech GesturesZhihao Yao, Xiwen Yao, Haowei Xiong, Yuan-Ling Feng 等CHI 2026 · 被引用 1 次
