ExplorAR: Assisting Older Adults to Learn Smartphone Apps through AR-powered Trial-and-Error with Interactive Guidance
Jiawei Li, Linjie Qiu, Zhiqing Wu, Qiongyan Chen, Ziyan Wang, Mingming Fan
Abstract
Older adults tend to encounter challenges when learning to use new smartphone apps due to age-related cognitive and physical changes. Compared to traditional support methods such as video tutorials, trial-and-error allows older adults to learn to use smartphone apps by making and correcting mistakes. However, it remains unknown how trial-and-error should be designed to empower older adults to use smartphone apps and how well it would work for older adults. Informed by the guidelines derived from prior work, we designed and implemented ExplorAR, an AR-based trial-and-error system that offers real-time and situated visual guidance in the augmented space around the smartphone to empower older adults to explore and correct mistakes independently. We conducted a user study with 18 older adults to compare ExplorAR with traditional video tutorials and a simplified version of ExplorAR. Results show that the AR-supported trial-and-error method enhanced older adults' learning experience by fostering deeper cognitive engagement and improving confidence in exploring unknown operations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 96b75c54-2bfc-4835-a961-7a16499d141eCited by top-tier papers1
Ask how each one uses itBuilds on10
- Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic InterfacesRyo Suzuki, Adnan Karim, Tian Xia, Hooman Hedayati et al.CHI 2022 · 243 citations
- Technology Adoption and Learning Preferences for Older Adults: : Evolving Perceptions, Ongoing Challenges, and Emerging Design OpportunitiesCarolyn Pang, Zhiqin Collin Wang, Joanna McGrenere, Rock Leung et al.CHI 2021 · 119 citations
- AppAgent: Multimodal Agents as Smartphone UsersChi Zhang, Zhao Yang, Jiaxuan Liu, Yanda Li et al.CHI 2025 · 57 citations
- Synapse: Interactive Guidance by Demonstration with Trial-and-Error Support for Older Adults to Use Smartphone AppsXiaofu Jin, Xiaozhu Hu, Xiaoying Wei, Mingming FanUbiComp 2022 · 36 citations
- Exploring the Opportunities of AR for Enriching Storytelling with Family Photos between Grandparents and GrandchildrenZisu Li, Li Feng, Chen Liang, Yuru Huang et al.UbiComp 2023 · 35 citations
Related papers
- Exploring the Opportunity of Augmented Reality (AR) in Supporting Older Adults to Explore and Learn Smartphone ApplicationsXiaofu Jin, Wai Tong, Xiaoying Wei, Xian Wang et al.CHI 2024 · 25 citations
- GuideMe: A VLM-Based System Assisting Independent Smartphone Learning for Older AdultsKairong Fang, Jiesi Zhang, Shi-Ting Ni, Pan Hui et al.CHI 2026 · 1 citation
- EasyAsk: An In-App Contextual Tutorial Search Assistant for Older Adults with Voice and Touch InputsWeiwei Gao, Kexin Du, Yujia Luo, Weinan Shi et al.UbiComp 2024 · 20 citations
- WePilot: Integrating Younger Family Members and Chatbot to Support Older Adults Learning Smartphone UsageHaonan Zhang, Peng Zhang, Yan Chen, Meitong Guo et al.CSCW 2025 · 1 citation
- An Iterative Participatory Design Approach to Develop Collaborative Augmented Reality Activities for Older Adults in Long-Term Care FacilitiesAkshith Ullal, Mahrukh Tauseef, Alexandra Watkins, Lisa Juckett et al.CHI 2024 · 32 citations
