Paper Trail: An Immersive Authoring System for Augmented Reality Instructional Experiences
Shwetha Rajaram, Michael Nebeling
Abstract
Prior work has demonstrated augmented reality’s benefits to education, but current tools are difficult to integrate with traditional instructional methods. We present Paper Trail, an immersive authoring system designed to explore how to enable instructors to create AR educational experiences, leaving paper at the core of the interaction and enhancing it with various forms of digital media, animations for dynamic illustrations, and clipping masks to guide learning. To inform the system design, we developed five scenarios exploring the benefits that hand-held and head-worn AR can bring to STEM instruction and developed a design space of AR interactions enhancing paper based on these scenarios and prior work. Using the example of an AR physics handout, we assessed the system’s potential with PhD-level instructors and its usability with XR design experts. In an elicitation study with high-school teachers, we study how Paper Trail could be used and extended to enable flexible use cases across various domains. We discuss benefits of immersive paper for supporting diverse student needs and challenges for making effective use of AR for learning.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c00060dc-45d7-4ee6-b920-fe53a1f69f77Cited by top-tier papers15
- Augmented Object Intelligence with XR-ObjectsMustafa Doga Dogan, Eric J. Gonzalez, Karan Ahuja, Ruofei Du et al.UIST 2024 · 64 citations
- Teachable Reality: Prototyping Tangible Augmented Reality with Everyday Objects by Leveraging Interactive Machine TeachingKyzyl Monteiro, Ritik Vatsal, Neil Chulpongsatorn, Aman Parnami et al.CHI 2023 · 55 citations
- Sketched Reality: Sketching Bi-Directional Interactions Between Virtual and Physical Worlds with AR and Actuated Tangible UIHiroki Kaimoto, Kyzyl Monteiro, Mehrad Faridan, Jiatong Li et al.UIST 2022 · 46 citations
- Augmented Math: Authoring AR-Based Explorable Explanations by Augmenting Static Math TextbooksNeil Chulpongsatorn, Mille Skovhus Lunding, Nishan Soni, Ryo SuzukiUIST 2023 · 36 citations
- Augmented Physics: Creating Interactive and Embedded Physics Simulations from Static Textbook DiagramsAditya Gunturu, Yi Wen, Nandi Zhang, Jarin Thundathil et al.UIST 2024 · 33 citations
Builds on11
- Creating Augmented and Virtual Reality Applications: Current Practices, Challenges, and OpportunitiesNarges Ashtari, Andrea Bunt, Joanna McGrenere, Michael Nebeling et al.CHI 2020 · 274 citations
- RealitySketch: Embedding Responsive Graphics and Visualizations in AR through Dynamic SketchingRyo Suzuki, Rubaiat Habib Kazi, Li-Yi Wei, Stephen DiVerdi et al.UIST 2020 · 98 citations
- Pronto: Rapid Augmented Reality Video Prototyping Using Sketches and EnactionGermán Leiva, Cuong Nguyen, Rubaiat Habib Kazi, Paul AsenteCHI 2020 · 96 citations
- XRDirector: A Role-Based Collaborative Immersive Authoring SystemMichael Nebeling, Katy Lewis, Yu-Cheng Chang, Lihan Zhu et al.CHI 2020 · 80 citations
- Meta-AR-App: An Authoring Platform for Collaborative Augmented Reality in STEM ClassroomsAna M. Villanueva, Zhengzhe Zhu, Ziyi Liu, Kylie Peppler et al.CHI 2020 · 76 citations
Related papers
- MechARspace: An Authoring System Enabling Bidirectional Binding of Augmented Reality with Toys in Real-timeZhengzhe Zhu, Ziyi Liu, Tianyi Wang, Youyou Zhang et al.UIST 2022 · 20 citations
- ProInterAR: A Visual Programming Platform for Creating Immersive AR InteractionsHui Ye, Jiaye Leng, Pengfei Xu, Karan Singh et al.CHI 2024 · 10 citations
- Educator Perceptions of XRAuthor: An Accessible Tool for Authoring Learning Content with Different Immersion LevelsSongjia Shen, Chek Tien Tan, Hsiang-Ting Chen, William L. Raffe et al.CHI 2025 · 3 citations
- PaperToPlace: Transforming Instruction Documents into Spatialized and Context-Aware Mixed Reality ExperiencesChen Chen, Cuong Nguyen, Jane Hoffswell, Jennifer Healey et al.UIST 2023 · 21 citations
- Understanding Young People's Creative Goals with Augmented RealityAmna Liaqat, Fannie Liu, Brian Berengard, Jiaxun Cao et al.CSCW 2025 · 3 citations
