ARTEMIS: A Collaborative Mixed-Reality System for Immersive Surgical Telementoring
Danilo Gasques, Janet G. Johnson, Tommy Sharkey, Yuanyuan Feng, Ru Wang, Zhuoqun Robin Xu, Enrique Zavala, Yifei Zhang, Wanze Xie, Xinming Zhang, Konrad Davis, Michael C. Yip, Nadir Weibel
Abstract
Traumatic injuries require timely intervention, but medical expertise is not always available at the patient’s location. Despite recent advances in telecommunications, surgeons still have limited tools to remotely help inexperienced surgeons. Mixed Reality hints at a future where remote collaborators work side-by-side as if co-located; however, we still do not know how current technology can improve remote surgical collaboration. Through role-playing and iterative-prototyping, we identify collaboration practices used by expert surgeons to aid novice surgeons as well as technical requirements to facilitate these practices. We then introduce ARTEMIS, an AR-VR collaboration system that supports these key practices. Through an observational study with two expert surgeons and five novice surgeons operating on cadavers, we find that ARTEMIS supports remote surgical mentoring of novices through synchronous point, draw, and look affordances and asynchronous video clips. Most participants found that ARTEMIS facilitates collaboration despite existing technology limitations explored in this paper.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8bfbe2be-572c-495f-acb9-009961990376Cited by top-tier papers20
- Hand Interfaces: Using Hands to Imitate Objects in AR/VR for Expressive InteractionsSiyou Pei, Alexander Chen, Jaewook Lee, Yang ZhangCHI 2022 · 93 citations
- A Survey on Remote Assistance and Training in Mixed Reality EnvironmentsCatarina G. Fidalgo, Yukang Yan, Hyunsung Cho, Maurício Sousa et al.IEEE VR 2023 · 69 citations
- HoloBots: Augmenting Holographic Telepresence with Mobile Robots for Tangible Remote Collaboration in Mixed RealityKeiichi Ihara, Mehrad Faridan, Ayumi Ichikawa, Ikkaku Kawaguchi et al.UIST 2023 · 42 citations
- ChameleonControl: Teleoperating Real Human Surrogates through Mixed Reality Gestural Guidance for Remote Hands-on ClassroomsMehrad Faridan, Bheesha Kumari, Ryo SuzukiCHI 2023 · 29 citations
- Supporting Collaborative Discussions In Surgical Teleconsulting Through Augmented Reality Head Mounted DisplaysSophie Maria, Helena M. Mentis, Geoffroy Canlorbe, Ignacio AvellinoCHI 2023 · 18 citations
Related papers
- Understanding Takeovers and Telestration in Laparoscopic Surgery to Inform Telementoring System DesignSolène Lambert, Sandrine Voros, Geoffroy Canlorbe, Jocelyne Troccaz et al.CHI 2024 · 10 citations
- Using Virtual Replicas to Improve Mixed Reality Remote CollaborationHuayuan Tian, Gun A. Lee, Huidong Bai, Mark BillinghurstIEEE VR 2023 · 57 citations
- UnMapped: Leveraging Experts' Situated Experiences to Ease Remote Guidance in Collaborative Mixed RealityJanet G. Johnson, Tommy Sharkey, Iramuali Cynthia Butarbutar, Danica Xiong et al.CHI 2023 · 14 citations
- Virtual Instruments: Beyond Telestration in Surgical TelementoringSolène Lambert, Sandrine Voros, Geoffroy Canlorbe, Sophie Maria et al.CSCW 2026
- Augmented Virtual Teleportation for High-Fidelity TelecollaborationTaehyun Rhee, Stephen Thompson, Daniel Medeiros, Rafael Kuffner dos Anjos et al.IEEE VR 2020 · 96 citations
