Stargazer: An Interactive Camera Robot for Capturing How-To Videos Based on Subtle Instructor Cues
Jiannan Li, Maurício Sousa, Karthik Mahadevan, Bryan Wang, Paula Akemi Aoyaui, Nicole Yu, Angela Yang, Ravin Balakrishnan, Anthony Tang, Tovi Grossman
Abstract
Live and pre-recorded video tutorials are an effective means for teaching physical skills such as cooking or prototyping electronics. A dedicated cameraperson following an instructor’s activities can improve production quality. However, instructors who do not have access to a cameraperson’s help often have to work within the constraints of static cameras. We present Stargazer, a novel approach for assisting with tutorial content creation with a camera robot that autonomously tracks regions of interest based on instructor actions to capture dynamic shots. Instructors can adjust the camera behaviors of Stargazer with subtle cues, including gestures and speech, allowing them to fluidly integrate camera control commands into instructional activities. Our user study with six instructors, each teaching a distinct skill, showed that participants could create dynamic tutorial videos with a diverse range of subjects, camera framing, and camera angle combinations using Stargazer.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 390f56e5-3241-4634-97f5-d5d1d5338c8eCited by top-tier papers2
- AQuA: Automated Question-Answering in Software Tutorial Videos with Visual AnchorsSaelyne Yang, Jo Vermeulen, George W. Fitzmaurice, Justin MatejkaCHI 2024 · 15 citations
- How Do We Research Human-Robot Interaction in the Age of Large Language Models? A Systematic ReviewYufeng Wang, Yuan Xu, Anastasia Nikolova, Yuxuan Wang et al.CHI 2026 · 4 citations
Builds on14
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video ClipsAntoine Miech, Dimitri Zhukov, Jean-Baptiste Alayrac, Makarand Tapaswi et al.ICCV 2019 · 1,437 citations
- RealitySketch: Embedding Responsive Graphics and Visualizations in AR through Dynamic SketchingRyo Suzuki, Rubaiat Habib Kazi, Li-Yi Wei, Stephen DiVerdi et al.UIST 2020 · 98 citations
- RealityTalk: Real-Time Speech-Driven Augmented Presentation for AR Live StorytellingJian Liao, Adnan Karim, Shivesh Singh Jadon, Rubaiat Habib Kazi et al.UIST 2022 · 44 citations
- RubySlippers: Supporting Content-based Voice Navigation for How-to VideosMinsuk Chang, Mina Huh, Juho KimCHI 2021 · 40 citations
Related papers
- Automatic Instructional Video Creation from a Markdown-Formatted TutorialPeggy Chi, Nathan Frey, Katrina Panovich, Irfan EssaUIST 2021 · 27 citations
- ASTEROIDS: Exploring Swarms of Mini-Telepresence Robots for Physical Skill DemonstrationJiannan Li, Maurício Sousa, Chu Li, Jessie Liu et al.CHI 2022 · 24 citations
- AdapTutAR: An Adaptive Tutoring System for Machine Tasks in Augmented RealityGaoping Huang, Xun Qian, Tianyi Wang, Fagun Patel et al.CHI 2021 · 93 citations
- ChameleonControl: Teleoperating Real Human Surrogates through Mixed Reality Gestural Guidance for Remote Hands-on ClassroomsMehrad Faridan, Bheesha Kumari, Ryo SuzukiCHI 2023 · 29 citations
- GAZED- Gaze-guided Cinematic Editing of Wide-Angle Monocular Video RecordingsK. L. Bhanu Moorthy, Moneish Kumar, Ramanathan Subramanian, Vineet GandhiCHI 2020 · 26 citations
