Local Implicit Ray Function for Generalizable Radiance Field Representation
Xin Huang, Qi Zhang, Ying Feng, Xiaoyu Li, Xuan Wang, Qing Wang
Abstract
Figure 1 . We propose LIRF to reconstruct radiance fields of unseen scenes for novel view synthesis. Given that current generalizable NeRF-like methods cast an infinitesimal ray to render a pixel at different scales, it causes excessive blurring and aliasing. Our method instead reasons about 3D conical frustums defined by the neighbor rays through the neighbor pixels (as shown in (a)). Our LIRF outputs the feature of any sample within the conical frustum in a continuous manner (as shown in (b)), which supports NeRF reconstruction at arbitrary scales. Compared with the previous method, our method can be generalized to represent the same unseen scene at multiple levels of details (as shown in (c)). Specifically, given a set of input views at a consistent image scale ×1, LIRF enables our method to both preserve sharp details in close-up shots (anti-blurring as shown in ×2 and ×4 results) and correctly render the zoomed-out images (anti-aliasing as shown in ×0.5 results).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b9caa907-6e85-4562-8666-077933af5676Cited by top-tier papers10
- PyNeRF: Pyramidal Neural Radiance FieldsHaithem Turki, Michael Zollhöfer, Christian Richardt, Deva RamananNeurIPS 2023 · 31 citations
- NeuroGauss4D-PCI: 4D Neural Fields and Gaussian Deformation Fields for Point Cloud InterpolationChaokang Jiang, Dalong Du, Jiuming Liu, Siting Zhu et al.NeurIPS 2024 · 10 citations
- InsertNeRF: Instilling Generalizability into NeRF with HyperNet ModulesYanqi Bao, Tianyu Ding, Jing Huo, Wenbin Li et al.ICLR 2024 · 7 citations
- SE(3) Equivariant Convolution and Transformer in Ray SpaceYinshuang Xu, Jiahui Lei, Kostas DaniilidisNeurIPS 2023 · 6 citations
- AlignMiF: Geometry-Aligned Multimodal Implicit Field for LiDAR-Camera Joint SynthesisTang Tao, Guangrun Wang, Yixing Lao, Peng Chen et al.CVPR 2024 · 6 citations
Builds on28
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman et al.ICCV 2021 · 2,700 citations
- Volume Rendering of Neural Implicit SurfacesLior Yariv, Jiatao Gu, Yoni Kasten, Yaron LipmanNeurIPS 2021 · 1,421 citations
- Plenoxels: Radiance Fields without Neural NetworksSara Fridovich-Keil, Alex Yu, Matthew Tancik, Qinhong Chen et al.CVPR 2022 · 1,237 citations
- MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View StereoAnpei Chen, Zexiang Xu, Fuqiang Zhao, Xiaoshuai Zhang et al.ICCV 2021 · 1,024 citations
- NeRD: Neural Reflectance Decomposition from Image CollectionsMark Boss, Raphael Braun, Varun Jampani, Jonathan T. Barron et al.ICCV 2021 · 608 citations
Related papers
- MuRF: Multi-Baseline Radiance FieldsHaofei Xu, Anpei Chen, Yuedong Chen, Christos Sakaridis et al.CVPR 2024 · 22 citations
- NeRF-SR: High Quality Neural Radiance Fields using SupersamplingChen Wang, Xian Wu, Yuan-Chen Guo, Song-Hai Zhang et al.ACM MM 2022 · 115 citations
- pixelNeRF: Neural Radiance Fields From One or Few ImagesAlex Yu, Vickie Ye, Matthew Tancik, Angjoo KanazawaCVPR 2021
- NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo CollectionsRicardo Martin-Brualla, Noha Radwan, Mehdi S. M. Sajjadi, Jonathan T. Barron et al.CVPR 2021
- 3D Reconstruction and Novel View Synthesis of Indoor Environments Based on a Dual Neural Radiance FieldZhenyu Bao, Guibiao Liao, Zhongyuan Zhao, Kanglin Liu et al.ACM MM 2024 · 3 citations
