TeamVision: An AI-powered Learning Analytics System for Supporting Reflection in Team-based Healthcare Simulation
Vanessa Echeverría, Linxuan Zhao, Riordan Alfredo, Mikaela Elizabeth Milesi, Yueqiao Jin, Sophie Abel, Jie Xiang Fan, Lixiang Yan, Samantha Dix, Rosie Wotherspoon, Xinyu Li, Hollie Jaggard
Abstract
Healthcare simulations help learners develop teamwork and clinical skills in a risk-free setting, promoting reflection on real-world practices through structured debriefs. However, despite video's potential, it is hard to use, leaving a gap in providing concise, data-driven summaries for supporting effective debriefing. Addressing this, we present TeamVision, an AI-powered multimodal learning analytics (MMLA) system that captures voice presence, automated transcriptions, body rotation, and positioning data, offering educators a dashboard to guide debriefs immediately after simulations. We conducted an in-the-wild study with 56 teams (221 students) and recorded debriefs led by six teachers using TeamVision. Follow-up interviews with 15 students and five teachers explored perceptions of its usefulness, accuracy, and trustworthiness. This paper examines: i) how TeamVision was used in debriefing, ii) what educators found valuable and challenging, and iii) perceptions of its effectiveness. Results suggest TeamVision enables flexible debriefing and highlights the challenges and implications of using AI-powered systems in healthcare simulation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 62793fd2-e284-45c1-8ab0-c5dd7cbfa8e4Cited by top-tier papers1
Ask how each one uses itBuilds on9
- Robust Speech Recognition via Large-Scale Weak SupervisionAlec Radford, Jong Wook Kim, Tao Xu, Greg Brockman et al.ICML 2023 · 6,966 citations
- Re-examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to DesignQian Yang, Aaron Steinfeld, Carolyn P. Rosé, John ZimmermanCHI 2020 · 604 citations
- Designerly Understanding: Information Needs for Model Transparency to Support Design Ideation for AI-Powered User ExperienceQ. Vera Liao, Hariharan Subramonyam, Jennifer Wang, Jennifer Wortman VaughanCHI 2023 · 81 citations
- MeetingCoach: An Intelligent Dashboard for Supporting Effective & Inclusive MeetingsSamiha Samrose, Daniel McDuff, Robert Sim, Jina Suh et al.CHI 2021 · 69 citations
- Exploring The Future of Data-Driven Product DesignKaterina Gorkovenko, Daniel J. Burnett, James K. Thorp, Daniel Richards et al.CHI 2020 · 46 citations
Related papers
- From Data to Insights: A Layered Storytelling Approach for Multimodal Learning AnalyticsRoberto Martínez Maldonado, Vanessa Echeverría, Gloria Fernández-Nieto, Simon Buckingham ShumCHI 2020 · 115 citations
- Leveraging Historical Medical Records as a Proxy via Multimodal Modeling and Visualization to Enrich Medical Diagnostic LearningYang Ouyang, Yuchen Wu, He Wang, Chenyang Zhang et al.IEEE VIS 2023 · 28 citations
- How a Clinical Decision Support System Changed the Diagnosis Process: Insights from an Experimental Mixed-Method Study in a Full-Scale Anesthesiology SimulationSara Wolf, Tobias Grundgeiger, Raphael Zähringer, Lora Shishkova et al.CHI 2025 · 10 citations
- The Hidden Workload: Student Data Work in Multimodal Algorithmic EvaluationsGonzalo Gabriel Méndez, Jhonston Hernan Benjumea, Leonardo Eras, Federico Domínguez et al.CSCW 2025
- Reimagining Multidisciplinary Teams: Challenges and Opportunities for LLMs in Cancer MDTsSoraia Figueiredo Paulo, Isabel Neto, Nuno Leitão Figueiredo, Daniel Simões Lopes et al.CSCW 2025 · 4 citations
