NIVM: Real-time View Morphing via Neural Implicit Function
Tung-I Chen, Dae Yeol Lee, Guan-Ming Su, Mohammad Hajiesmaili, Ramesh K. Sitaraman
Abstract
We present NIVM, a lightweight and efficient view morphing framework that learns coordinate transforms between views, enabling real-time, user-controlled perspective shifts on resource-constrained devices. Unlike existing view interpolation methods that compromise visual quality or require high data overhead, NIVM integrates seamlessly into multi-view video streams as compact metadata per frame, enabling the synthesis of high-quality intermediate views and interactive transitions from sparse viewpoints. To avoid dependence on explicit 3D geometry, which may be unavailable, we introduce a dual-branch training strategy: a teacher network operates in rectified stereo space to supervise the morpher in the original image domain. By inheriting the monotonicity constraints of epipolar geometry, our morphing network produces visually plausible pixel flows while avoiding the reprojection artifacts prevalent in depth-based methods. Compared to recent pose-free sparse-view Gaussian Splatting approaches, NIVM achieves competitive results without the need to construct or transmit volumetric representations. Experiments show that NIVM achieves the lowest memory footprint, highest inference efficiency, and top-tier visual quality across multiple benchmark datasets.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 0fd3fb2a-91b4-483c-803d-538edd74d251Cited by top-tier papers1
Ask how each one uses itRelated papers
- Compressing Streamable Free-Viewpoint Videos to 0.1 MB per FrameLuyang Tang, Jiayu Yang, Rui Peng, Yongqi Zhai et al.AAAI 2025 · 7 citations
- GSReuse: Temporally Adaptive Screen-Space Reuse for Accelerating 3D Gaussian SplattingChengzhi Tao, Yiyang Sun, Jie Guo, Tao Zhang et al.IEEE VR 2026
- NopeRoomGS: Indoor 3D Gaussian Splatting Optimization without Camera Pose InputWenbo Li, Yan Xu, Mingde Yao, Fengjie Liang et al.NeurIPS 2025 · 1 citation
- Many-to-many Splatting for Efficient Video Frame InterpolationPing Hu, Simon Niklaus, Stan Sclaroff, Kate SaenkoCVPR 2022 · 63 citations
- QUEEN: QUantized Efficient ENcoding of Dynamic Gaussians for Streaming Free-viewpoint VideosSharath Girish, Tianye Li, Amrita Mazumdar, Abhinav Shrivastava et al.NeurIPS 2024 · 37 citations
