Lune

CHI2026Top-tier venue

ComVi: Context-Aware Optimized Comment Display in Video Playback

Minsun Kim, Dawon Lee, Junyong Noh

Abstract

On general video-sharing platforms like YouTube, comments are displayed independently of video playback. As viewers often read comments while watching a video, they may encounter ones referring to moments unrelated to the current scene, which can reveal spoilers and disrupt immersion. To address this problem, we present ComVi, a novel system that displays comments at contextually relevant moments, enabling viewers to see time-synchronized comments and video content together. We first map all comments to relevant video timestamps by computing audio-visual correlation, then construct the comment sequence through an optimization that considers temporal relevance, popularity (number of likes), and display duration for comfortable reading. In a user study, ComVi provided a significantly more engaging experience than conventional video interfaces (i.e., YouTube and Danmaku), with 71.9% of participants selecting ComVi as their most preferred interface.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Builds on20

  1. Robust Speech Recognition via Large-Scale Weak SupervisionAlec Radford, Jong Wook Kim, Tao Xu, Greg Brockman et al.ICML 2023 · 6,966 citations
  2. MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained TransformersWenhui Wang, Furu Wei, Li Dong, Hangbo Bao et al.NeurIPS 2020 · 2,727 citations
  3. VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow EstimationXiaoyu Shi, Zhaoyang Huang, Weikang Bian, Dasong Li et al.ICCV 2023 · 112 citations
  4. Automatic Generation of Two-Level Hierarchical Tutorials from Instructional Makeup VideosAnh Truong, Peggy Chi, David Salesin, Irfan Essa et al.CHI 2021 · 57 citations
  5. Phrase-BERT: Improved Phrase Embeddings from BERT with an Application to Corpus ExplorationShufan Wang, Laure Thompson, Mohit IyyerEMNLP 2021 · 53 citations

Related papers

  1. DanmuA11y: Making Time-Synced On-Screen Video Comments (Danmu) Accessible to Blind and Low Vision Users via Multi-Viewer Audio DiscussionsShuchang Xu, Xiaofu Jin, Huamin Qu, Yukang YanCHI 2025 · 26 citations
  2. Bullet Comments for 360°VideoYijun Li, Jin-Chuan Shi, Fang-Lue Zhang, Miao WangIEEE VR 2022 · 20 citations
  3. "I feel lonely when they stop chatting": Exploring Auditory Comment Display for Eyes-Free Social-Viewing Experience in Online Music VideosYuki Abe, Daisuke Sakamoto, Tetsuo OnoCSCW 2025
  4. HOTVCOM: Generating Buzzworthy Comments for VideosYuyan Chen, Songzhou Yan, Qingpei Guo, Jiyuan Jia et al.ACL Findings 2024 · 5 citations
  5. VideoIC: A Video Interactive Comments Dataset and Multimodal Multitask Learning for Comments GenerationWeiying Wang, Jieting Chen, Qin JinACM MM 2020 · 26 citations
Dusk over the sea between two cliffs drawn in fine vertical lines