Mobile3DGS3: Accelerate Mobile 3DGS Rendering via Gradient-Aware Super-Sampling and Frame Interpolation
Fan Gao, Yibo Zhao, Changhao Song, Jiarui Wen, Yuxuan Song, Youcheng Cai, Ligang Liu
摘要
Achieving high-quality real-time rendering on mobile devices is critical for immersive 3D applications, yet 3D Gaussian Splatting (3DGS) faces significant challenges on resource-constrained mobile platforms, with sustaining 60 FPS at 2K resolution remaining difficult despite recent advances. Rather than further optimizing the core splatting pipeline, we explore 3DGS acceleration through post-rendering techniques leveraging gradient for super-sampling and frame interpolation. We propose Mobile3DGS3, a lightweight framework that alternates between super-sampling and frame interpolation. Our framework introduces three key innovations: Tangent Space Gradient Caching (TSGC), which converts gradient into cached geometric invariants enabling seamless integration with hardware-accelerated rasterization; Gradient-Aware Super-Sampling (GASS), which leverages Gaussian splat differentiability to upsample low-resolution images while preserving details; and Gradient-Aware Frame Interpolation (GAFI), which resamples gradient from adjacent frames with efficient motion vector upscaling for NPU-compatible processing. Extensive experiments demonstrate significant rendering efficiency improvements on mobile devices while maintaining high visual fidelity, presenting the first 3DGS acceleration paradigm on mobile devices that effectively leverages gradient in both super-sampling and frame interpolation. Code repository: https://github.com/SyouSanGin/Mobile3DGS3
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- Lightweight Gradient-Aware Upscaling of 3D Gaussian Splatting ImagesSimon Niedermayr, Christoph Neuhauser, Rüdiger WestermannICCV 2025 · 被引用 2 次
- Seele: A Unified Acceleration Framework for Real-Time Gaussian Splatting on Mobile DevicesHe Zhu, Xiaotong Huang, Zihan Liu, Weikai Lin 等CVPR 2026
- Mob-FGSR: Frame Generation and Super Resolution for Mobile Real-Time RenderingSipeng Yang, Qingchuan Zhu, Junhao Zhuge, Qiang Qiu 等SIGGRAPH 2024 · 被引用 17 次
- STREAMINGGS: Voxel-Based Streaming 3D Gaussian Splatting with Memory Optimization and Architectural SupportChenqi Zhang, Yu Feng, Jieru Zhao, Guangda Liu 等DAC 2025 · 被引用 4 次
- Mobile-GS: Real-time Gaussian Splatting for Mobile DevicesXiaobiao Du, Yida Wang, Kun Zhan, Xin YuICLR 2026 · 被引用 13 次
