Passive Haptic Rehearsal for Augmented Piano Learning in the Wild
Tan Gemicioglu, Elijah Hopper, Brahmi Dwivedi, Richa Kulkarni, Asha Bhandarkar, Priyanka Rajan, Nathan Eng, Adithya Ramanujam, Charles Ramey, Scott M. Gilliland, Celeste Mason, Caitlyn E. Seim, Thad Starner
Abstract
Fig. 1. a) Haptic gloves for daily passive haptic rehearsal. b) Practicing piano with our piano education system and a Casio keyboard. c) Online learning portal of our piano education system.
Passive haptic learning (PHL) is a method for training motor skills via intensive repetition of haptic stimuli while a user is focused on other tasks. For the practical application of PHL to music education, we propose passive haptic rehearsal (PHR) where PHL is combined with deliberate active practice. We designed a piano teaching system that includes haptic gloves compatible with daily wear, a Casio keyboard with light-up keys, and an online learning portal that enables users to track performance, choose lessons, and connect with the gloves and keyboard. We conducted a longitudinal two-week study in the wild, where 36 participants with musical experience learned to play two piano songs with and without PHR. For 20 participants with complete and valid data, we found that PHR boosted the learning rate for the matching accuracy by 49.7% but did not have a significant effect on learning the notes' rhythm. Participants across all skill levels in the study require approximately two days less to reach mastery on the songs practiced when using PHR. We also confirmed that PHR boosts recall between active practice sessions. We hope that our results and system will enable the deployment of PHL beyond the laboratory.
CCS Concepts: • Human-centered computing → Haptic devices; Empirical studies in ubiquitous and mobile computing; Ubiquitous and mobile devices.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a172f8d1-2923-43aa-be02-e50c8b84cd21Cited by top-tier papers1
Ask how each one uses itBuilds on4
- DigituSync: A Dual-User Passive Exoskeleton Glove That Adaptively Shares Hand GesturesJun Nishida, Yudai Tanaka, Romain Nith, Pedro LopesUIST 2022 · 32 citations
- Let's Frets! Assisting Guitar Students During Practice via Capacitive SensingKarola Marky, Andreas Weiß, Andrii Matviienko, Florian Brandherm et al.CHI 2021 · 26 citations
- Investigating Retention in Passive Haptic Learning of Piano SongsRumen Donchev, Erik Pescara, Michael BeiglUbiComp 2021 · 16 citations
- Investigating Passive Haptic Learning of Piano Songs Using Three Tactile Sensations of Vibration, Stroking and TappingLikun Fang, Timo Müller, Erik Pescara, Nikola Fischer et al.UbiComp 2023 · 15 citations
Related papers
- Hapticus: Exploring the Effects of Haptic Feedback and its Customization on Motor Skill Learning: Tactile, Haptic, and Somatosensory ApproachesKyungyeon Lee, Daniel S. Yang, Kriti Singh, Jun NishidaCHI 2025 · 15 citations
- Skill-Adaptive Ghost Instructors: Enhancing Retention and Reducing Over-Reliance in VR Piano LearningTzu-Hsin Hsieh, Cassandra Michelle Stefanie Visser, Elmar Eisemann, Ricardo MarroquimCHI 2026 · 1 citation
- ReTouche: Embodied Representations for Self-Guided Piano LearningPaul-Peter Arslan, Hayoun Noh, Mariana Aki Tamashiro, Louis Badr et al.CHI 2026 · 1 citation
- Adaptive Electrical Muscle Stimulation Improves Muscle MemorySiya Choudhary, Romain Nith, Yun Ho, Jas Brooks et al.CHI 2025 · 7 citations
- Muscle Synergies Learning with Electrical Muscle Stimulation for Playing the PianoArinobu Niijima, Toki Takeda, Ryosuke Aoki, Shinji MiyaharaUIST 2022 · 23 citations
