Skill-Adaptive Ghost Instructors: Enhancing Retention and Reducing Over-Reliance in VR Piano Learning
Tzu-Hsin Hsieh, Cassandra Michelle Stefanie Visser, Elmar Eisemann, Ricardo Marroquim
摘要
Motor-skill learning systems in XR rely on persistent cues. However, constant cueing can induce overreliance and erode memorization and skill transfer. We introduce a skill-adaptive, dynamically transparent ghost instructor whose opacity adapts in real time to learner performance. In a first-person perspective, users observe a ghost hand executing piano fingering with either a static or a performance-adaptive transparency in a VR piano training application. We conducted a within-subjects study (N=30), where learners practiced with traditional Static (fixed-transparency) and our proposed Dynamic (performance-adaptive) modes and were tested without guidance immediately and after a 10-minute retention interval. Relative to Static, the Dynamic mode yielded higher pitch and fingering accuracy and limited error increases, with comparable timing. These findings suggest that adaptive transparency helps learners internalize fingerings more effectively, reducing dependency on external cues and improving short-term skill retention within immersive learning environments. We discuss design implications for motor-skill learning and outline directions for extending this approach to longer-term retention and more complex tasks.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper6
- ARTEMIS: A Collaborative Mixed-Reality System for Immersive Surgical TelementoringDanilo Gasques, Janet G. Johnson, Tommy Sharkey, Yuanyuan Feng 等CHI 2021 · 被引用 144 次
- Effects of Collaborative Training Using Virtual Co-embodiment on Motor Skill LearningDaiki Kodama, Takato Mizuho, Yuji Hatada, Takuji Narumi 等IEEE VR 2023 · 被引用 61 次
- Wish You Were Here: Mental and Physiological Effects of Remote Music Collaboration in Mixed RealityRuben Schlagowski, Dariia Nazarenko, Yekta Said Can, Kunal Gupta 等CHI 2023 · 被引用 39 次
- DigituSync: A Dual-User Passive Exoskeleton Glove That Adaptively Shares Hand GesturesJun Nishida, Yudai Tanaka, Romain Nith, Pedro LopesUIST 2022 · 被引用 32 次
- Hapticus: Exploring the Effects of Haptic Feedback and its Customization on Motor Skill Learning: Tactile, Haptic, and Somatosensory ApproachesKyungyeon Lee, Daniel S. Yang, Kriti Singh, Jun NishidaCHI 2025 · 被引用 15 次
相关 Paper
- Correction of Avatar Hand Movements Supports Learning of a Motor SkillKlemen Lilija, Søren Kyllingsbæk, Kasper HornbækIEEE VR 2021 · 被引用 23 次
- Watch This! Observational Learning in VR Promotes Better Far Transfer than Active Learning for a Fine Psychomotor TaskIsabel Sophie Fitton, Elizabeth Dark, Manoela Milena Oliveira da Silva, Jeremy Dalton 等CHI 2024 · 被引用 14 次
- Do It Fast, Forget It Fast: How Timing and Limb Visualizations Affect First-Person Augmented Reality InstructionsClara Sayffaerth, Ehbal Ablimit, Annika Köhler, Jonas Wombacher 等CHI 2026 · 被引用 1 次
- "One Body, But Four Hands": Exploring the Role of Virtual Hands in Virtual Co-embodimentJingjing Zhang, Xiyao Jin, Han Tu, Hai-Ning Liang 等IEEE VR 2025 · 被引用 4 次
- Passive Haptic Rehearsal for Augmented Piano Learning in the WildTan Gemicioglu, Elijah Hopper, Brahmi Dwivedi, Richa Kulkarni 等UbiComp 2025 · 被引用 7 次
