NIVM: Real-time View Morphing via Neural Implicit Function
Tung-I Chen, Dae Yeol Lee, Guan-Ming Su, Mohammad Hajiesmaili, Ramesh K. Sitaraman
摘要
We present NIVM, a lightweight and efficient view morphing framework that learns coordinate transforms between views, enabling real-time, user-controlled perspective shifts on resource-constrained devices. Unlike existing view interpolation methods that compromise visual quality or require high data overhead, NIVM integrates seamlessly into multi-view video streams as compact metadata per frame, enabling the synthesis of high-quality intermediate views and interactive transitions from sparse viewpoints. To avoid dependence on explicit 3D geometry, which may be unavailable, we introduce a dual-branch training strategy: a teacher network operates in rectified stereo space to supervise the morpher in the original image domain. By inheriting the monotonicity constraints of epipolar geometry, our morphing network produces visually plausible pixel flows while avoiding the reprojection artifacts prevalent in depth-based methods. Compared to recent pose-free sparse-view Gaussian Splatting approaches, NIVM achieves competitive results without the need to construct or transmit volumetric representations. Experiments show that NIVM achieves the lowest memory footprint, highest inference efficiency, and top-tier visual quality across multiple benchmark datasets.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
引用它的顶会 Paper1
问问它们各自怎么用它相关 Paper
- Compressing Streamable Free-Viewpoint Videos to 0.1 MB per FrameLuyang Tang, Jiayu Yang, Rui Peng, Yongqi Zhai 等AAAI 2025 · 被引用 7 次
- GSReuse: Temporally Adaptive Screen-Space Reuse for Accelerating 3D Gaussian SplattingChengzhi Tao, Yiyang Sun, Jie Guo, Tao Zhang 等IEEE VR 2026
- NopeRoomGS: Indoor 3D Gaussian Splatting Optimization without Camera Pose InputWenbo Li, Yan Xu, Mingde Yao, Fengjie Liang 等NeurIPS 2025 · 被引用 1 次
- Many-to-many Splatting for Efficient Video Frame InterpolationPing Hu, Simon Niklaus, Stan Sclaroff, Kate SaenkoCVPR 2022 · 被引用 63 次
- QUEEN: QUantized Efficient ENcoding of Dynamic Gaussians for Streaming Free-viewpoint VideosSharath Girish, Tianye Li, Amrita Mazumdar, Abhinav Shrivastava 等NeurIPS 2024 · 被引用 37 次
