Temporal Segmentation of Creative Live Streams
C. Ailie Fraser, Joy O. Kim, Hijung Valentina Shin, Joel Brandt, Mira Dontcheva
Abstract
Many artists broadcast their creative process through live streaming platforms like Twitch and YouTube, and people often watch archives of these broadcasts later for learning and inspiration. Unfortunately, because live stream videos are often multiple hours long and hard to skim and browse, few can leverage the wealth of knowledge hidden in these archives. We present an approach for automatic temporal segmentation of creative live stream videos. Using an audio transcript and a log of software usage, the system segments the video into sections that the artist can optionally label with meaningful titles. We evaluate this approach by gathering feedback from expert streamers and comparing automatic segmentations to those made by viewers. We find that, while there is no one "correct" way to segment a live stream, our automatic method performs similarly to viewers, and streamers find it useful for navigating their streams after making slight adjustments and adding section titles.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers17
- A Literature Review of Video-Sharing Platform Research in HCIAva Bartolome, Shuo NiuCHI 2023 · 63 citations
- What We Can Learn From Visual Artists About Software DevelopmentJingyi Li, Sonia Hashim, Jennifer JacobsCHI 2021 · 62 citations
- Automatic Generation of Two-Level Hierarchical Tutorials from Instructional Makeup VideosAnh Truong, Peggy Chi, David Salesin, Irfan Essa et al.CHI 2021 · 57 citations
- Towards Supporting Programming Education at Scale via Live StreamingYan Chen, Walter S. Lasecki, Tao DongCSCW 2020 · 45 citations
- AVscript: Accessible Video Editing with Audio-Visual ScriptsMina Huh, Saelyne Yang, Yi-Hao Peng, Xiang 'Anthony' Chen et al.CHI 2023 · 44 citations
Related papers
- Snapstream: Snapshot-based Interaction in Live Streaming for Visual ArtSaelyne Yang, Changyoon Lee, Hijung Valentina Shin, Juho KimCHI 2020 · 41 citations
- StreamSketch: Exploring Multi-Modal Interactions in Creative Live StreamsZhicong Lu, Rubaiat Habib Kazi, Li-Yi Wei, Mira Dontcheva et al.CSCW 2021 · 40 citations
- SeeHow: Workflow Extraction from Programming Screencasts through Action-Aware Video AnalyticsDehai Zhao, Zhenchang Xing, Xin Xia, Deheng Ye et al.ICSE 2023 · 6 citations
- Understanding Analytics Needs of Video Game StreamersKeri Mallari, Spencer Williams, Gary HsiehCHI 2021 · 31 citations
- Channeling End-User Creativity: Leveraging Live Streaming for Distributed Collaboration in Indie Game DevelopmentLingyuan Li, Guo Freeman, Nathan J. McNeeseCSCW 2022 · 13 citations
