Task Breakpoint Generation using Origin-Centric Graph in Virtual Reality Recordings for Adaptive Playback
Selin Choi, Dooyoung Kim, Taewook Ha, Seonji Kim, Woontack Woo
摘要
We propose a method for generating task breakpoints based on an Origin-Centric Graph (OCG) to segment goal-oriented activity recordings into task units for adaptive playback in Virtual Reality (VR) environments. With the development of Augmented Reality (AR)/VR head-mounted displays (HMDs), research on adaptive tutorials and authoring tools has become active, but existing task segmentation methods mainly rely on manual annotation or are restricted to 2D video which limits their applicability to 3D VR contexts. In our approach, assembly scenarios with clearly defined task boundaries are recorded using a structured spatio-temporal scene graph (STSG), and the OCG is employed to track changes in the central object and the formation of new groups, thereby generating task breakpoints automatically. A user study collected user-perceived task breakpoints to establish ground truth (GT), and comparison with the algorithm-detected breakpoints demonstrated high agreement and confirmed accuracy in supporting adaptive playback. The proposed task segmentation method provides a foundation for dynamically adjusting VR playback according to user proficiency and progress, with potential for extension into automatic timeline segmentation systems for diverse VR recordings.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper13
- SlowFast Networks for Video RecognitionChristoph Feichtenhofer, Haoqi Fan, Jitendra Malik, Kaiming HeICCV 2019 · 被引用 4,104 次
- ReLive: Bridging In-Situ and Ex-Situ Visual Analytics for Analyzing Mixed Reality User StudiesSebastian Hubenschmid, Jonathan Wieland, Daniel Immanuel Fink, Andrea Batch 等CHI 2022 · 被引用 99 次
- AdapTutAR: An Adaptive Tutoring System for Machine Tasks in Augmented RealityGaoping Huang, Xun Qian, Tianyi Wang, Fagun Patel 等CHI 2021 · 被引用 93 次
- Generic Event Boundary Detection: A Benchmark for Event SegmentationMike Zheng Shou, Stan Weixian Lei, Weiyao Wang, Deepti Ghadiyaram 等ICCV 2021 · 被引用 91 次
- Compositional Video Synthesis with Action GraphsAmir Bar, Roei Herzig, Xiaolong Wang, Anna Rohrbach 等ICML 2021 · 被引用 48 次
相关 Paper
- Video-Annotated Augmented Reality Assembly TutorialsMasahiro Yamaguchi, Shohei Mori, Peter Mohr, Markus Tatzgern 等UIST 2020 · 被引用 37 次
- Generating Activity Snippets by Learning Human-Scene InteractionsChangyang Li, Lap-Fai YuSIGGRAPH 2023 · 被引用 10 次
- HIG: Hierarchical Interlacement Graph Approach to Scene Graph Generation in Video UnderstandingTrong-Thuan Nguyen, Pha A. Nguyen, Khoa LuuCVPR 2024 · 被引用 5 次
- Using Virtual Replicas to Improve Mixed Reality Remote CollaborationHuayuan Tian, Gun A. Lee, Huidong Bai, Mark BillinghurstIEEE VR 2023 · 被引用 57 次
- Progress-Aware Online Action Segmentation for Egocentric Procedural Task VideosYuhan Shen, Ehsan ElhamifarCVPR 2024 · 被引用 14 次
