Sophon: Super-Resolution Enhanced 360° Video Streaming with Visual Saliency-aware Prefetch
Jianxin Shi, Lingjun Pu, Xinjing Yuan, Qianyun Gong, Jingdong Xu
摘要
360° video streaming requires ultra-high bandwidth to provide an excellent immersive experience. Traditional viewport-aware streaming methods are theoretically effective but unreliable in practice due to the adverse effects of time-varying available bandwidth on the small playback buffer. To this end, we ponder the complementarity between the large buffer-based approach and the viewport-aware strategy for 360°video streaming. In this work, we present Sophon, a buffer-based and neural-enhanced streaming framework, which exploits the double buffer design, super-resolution technique, and viewport-aware strategy to improve user experience. Furthermore, we propose two well-suited ideas: visual saliency-aware prefetch and super-resolution model selection scheme to address the challenges of insufficient computing resources and dynamic user preferences. Correspondingly, we respectively introduce the prefetch and model selection metric, and develop a lightweight buffer occupancy-based prefetch algorithm and a deep reinforcement learning method to trade off bandwidth consumption, computing resource utilization, and content quality enhancement. We implement a prototype of Sophon and extensive evaluations corroborate its superior performance over state-of-the-art works.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
引用它的顶会 Paper2
- EOS: Energy-Optimized Super-Resolution on Mobile Devices for Live 360-Degree VideosSeonghoon Park, Minchan Kim, Hyejin Park, Jeho Lee 等MobiCom 2025 · 被引用 2 次
- Adaptive 360-Degree Video Streaming with Super-Resolution and InterpolationSiyuan Hong, Ruiqi Wang, Guohong CaoIEEE VR 2025 · 被引用 2 次
相关 Paper
- Streaming 360-Degree Videos Using Super-ResolutionMallesham Dasari, Arani Bhattacharya, Santiago Vargas, Pranjal Sahu 等INFOCOM 2020 · 被引用 142 次
- Personalized 360-Degree Video Streaming: A Meta-Learning ApproachYiyun Lu, Yifei Zhu, Zhi WangACM MM 2022 · 被引用 28 次
- LiveObj: Object Semantics-based Viewport Prediction for Live Mobile Virtual Reality StreamingXianglong Feng, Zeyang Bao, Sheng WeiIEEE VR 2021 · 被引用 33 次
- SalientVR: saliency-driven mobile 360-degree video streaming with gaze informationShibo Wang, Shusen Yang, Hailiang Li, Xiaodan Zhang 等MobiCom 2022 · 被引用 43 次
- TBSR: Tile-Based 360° Video Streaming with Super-Resolution on Commodity Mobile DevicesLei Zhang, Haobin Zhou, Haiyang Wang, Laizhong CuiINFOCOM 2024 · 被引用 10 次
