When XR and AI Meet - A Scoping Review on Extended Reality and Artificial Intelligence
Teresa Hirzle, Florian Müller, Fiona Draxler, Martin Schmitz, Pascal Knierim, Kasper Hornbæk
Abstract
Research on Extended Reality (XR) and Artificial Intelligence (AI) is booming, which has led to an emerging body of literature in their intersection. However, the main topics in this intersection are unclear, as are the benefits of combining XR and AI. This paper presents a scoping review that highlights how XR is applied in AI research and vice versa. We screened 2619 publications from 203 international venues published between 2017 and 2021, followed by an in-depth review of 311 papers. Based on our review, we identify five main topics at the intersection of XR and AI, showing how research at the intersection can benefit each other. Furthermore, we present a list of commonly used datasets, software, libraries, and models to help researchers interested in this intersection. Finally, we present 13 research opportunities and recommendations for future work in XR and AI research.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext de04892d-2ac9-424b-bdac-6f5261728ec3Cited by top-tier papers11
- LLMR: Real-time Prompting of Interactive Worlds using Large Language ModelsFernanda De La Torre, Cathy Mengying Fang, Han Huang, Andrzej Banburski-Fahey et al.CHI 2024 · 124 citations
- Augmented Object Intelligence with XR-ObjectsMustafa Doga Dogan, Eric J. Gonzalez, Karan Ahuja, Ruofei Du et al.UIST 2024 · 64 citations
- Born to Run, Programmed to Play: Mapping the Extended Reality Exergames LandscapeSukran Karaosmanoglu, Sebastian Cmentowski, Lennart E. Nacke, Frank SteinickeCHI 2024 · 37 citations
- HapticGen: Generative Text-to-Vibration Model for Streamlining Haptic DesignYoujin Sung, Kevin John, Sang Ho Yoon, Hasti SeifiCHI 2025 · 17 citations
- "You'll Be Alice Adventuring in Wonderland!" Processes, Challenges, and Opportunities of Creating Animated Virtual Reality StoriesLinping Yuan, Feilin Han, Liwenhan Xie, Junjie Zhang et al.CHI 2025 · 7 citations
Builds on66
- How WEIRD is CHI?Sebastian Linxen, Christian Sturm, Florian Brühlmann, Vincent Cassau et al.CHI 2021 · 254 citations
- Text2Gestures: A Transformer-Based Network for Generating Emotive Body Gestures for Virtual Agents**This work has been supported in part by ARO Grants W911NF1910069 and W911NF1910315, and Intel. Code and additional materials available at: https: //gamma.umd.edu/t2gUttaran Bhattacharya, Nicholas Rewkowski, Abhishek Banerjee, Pooja Guhan et al.IEEE VR 2021 · 147 citations
- SemanticAdapt: Optimization-based Adaptation of Mixed Reality Layouts Leveraging Virtual-Physical Semantic ConnectionsYifei Cheng, Yukang Yan, Xin Yi, Yuanchun Shi et al.UIST 2021 · 143 citations
- xR-EgoPose: Egocentric 3D Human Pose From an HMD CameraDenis Tomè, Patrick Peluse, Lourdes Agapito, Hernán BadinoICCV 2019 · 140 citations
- Extended Reality (XR) Remote Research: a Survey of Drawbacks and OpportunitiesJack Ratcliffe, Francesco Soave, Nick Bryan-Kinns, Laurissa Tokarchuk et al.CHI 2021 · 136 citations
Related papers
- LLM Integration in Extended Reality: A Comprehensive Review of Current Trends, Challenges, and Future PerspectivesYiliu Tang, Jason Situ, Andrea Yaoyun Cui, Mengke Wu et al.CHI 2025 · 37 citations
- Synthesizing Six Years of AR/VR Research: A Systematic Review of Machine and Deep Learning ApplicationsSarker Monojit Asish, Bhoj B. Karki, Bharat KC, Niloofar Kolahchi et al.IEEE VR 2025 · 6 citations
- Mapping the Landscape of Affective Extended Reality: A Scoping Review of Biodata-Driven Systems for Understanding and Sharing EmotionsZhidian Lin, Allison Jing, Ziyuan Qu, Fabio Zambetta et al.CHI 2026 · 2 citations
- Virtual and Augmented Reality for Environmental Sustainability: A Systematic ReviewLaura D. Cosio, Oguz 'Oz' Buruk, Daniel Fernández Galeote, Isak de Villiers Bosman et al.CHI 2023 · 76 citations
- Consideration of Human Values in Extended Reality: A Systematic ReviewMengxing Li, Yidan Zhang, Tim Dwyer, Taghreed Alshehri et al.IEEE VR 2026
