Tangible Immersive Trauma Simulation: Is Mixed Reality the next level of medical skills training?
Jakob Carl Uhl, Helmut Schrom-Feiertag, Georg Regal, Katja Gallhuber, Manfred Tscheligi
Abstract
In medical simulation training two approaches are currently rather disjunct: realistic manikins are used to teach physical skills and procedures and VR systems are used to train situation assessment and decision making. We propose a mixed reality approach, which allows trainees to use real tools and their hands when interacting with a physical manikin overlaid with a responsive virtual avatar. In close exchange with first responder organizations, we developed and evaluated an MR training scenario. In the scenario, users can talk to injured people in a car accident, assess the threat of the environment, and utilize real medical equipment. Participants experienced high levels of physical- and self-presence, increased stress levels, and reported a high technology acceptance. The proposed main requirements of first responders regarding haptic multi-sensory skill training in MR and the lessons learned from the workshop aim to guide the design of training solutions for medical training in MR.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Cited by top-tier papers4
- Let's Talk Futures: A Literature Review of HCI's Future OrientationCamilo Sanchez, Sui Wang, Kaisa Savolainen, Felix Anand Epp et al.CHI 2025 · 30 citations
- WELDAR: Augmenting Live Hands-On Training with In-Situ Guidance for Novice LearnersChuhan (Franklin) Xu, Lia Sparingga Purnamasari, Zhenfang Chen, Daragh Byrne et al.CHI 2026 · 1 citation
- EgoPoseVR: Spatiotemporal Multi-Modal Reasoning for Egocentric Full-Body Pose in Virtual RealityHaojie Cheng, Shaun Jing Heng Ong, Shaoyu Cai, Aiden Tat Yang Koh et al.IEEE VR 2026 · 1 citation
- Visual Augmentations for Ultrasound Assessment Training of Medical StudentsHelena Bøjer Djernæs, Rune Møberg Jacobsen, Simo Hosio, Niels van BerkelCHI 2025
Related papers
- Choosing the Right Reality: A Comparative Analysis of Tangibility in Immersive Trauma SimulationsJakob Carl Uhl, Rodrigo Gutierrez Maquilon, Georg Regal, Helmut Schrom-Feiertag et al.CHI 2024 · 12 citations
- MRehab: A Mixed Reality Rehabilitation System Supporting Integrated Speech and Hand TrainingQi Wang, Can Luo, Shuai Yang, Shuo Xu et al.UbiComp 2024 · 5 citations
- A Mixed Reality System for Robust Manikin Localization in Childbirth TrainingHaojie Cheng, Chang Liu, Abhiram Kanneganti, Mahesh Arjandas Choolani et al.IEEE VR 2026
- MRAT: The Mixed Reality Analytics ToolkitMichael Nebeling, Maximilian Speicher, Xizi Wang, Shwetha Rajaram et al.CHI 2020 · 65 citations
- Bridging Simulation and Reality: Augmented Virtuality for Mass Casualty Triage Training - From Landscape Analysis to Empirical InsightsYang Chen, Katherine Fennedy, Jiayi Zhang, Yong Jie Sim et al.CHI 2025 · 3 citations
