AligNeRF: High-Fidelity Neural Radiance Fields via Alignment-Aware Training
Yifan Jiang, Peter Hedman, Ben Mildenhall, Dejia Xu, Jonathan T. Barron, Zhangyang Wang, Tianfan Xue
Abstract
Our AligNeRF Ground Truth (Warped) w/ Alignment-aware Training w/o Alignment-aware Training Estimated Optical Flow
Figure 1. Left: Images rendered by mip-NeRF 360 [2] (w/o alignment-aware training) and our AligNeRF (w/ alignment-aware training), with the same amount of training time for both methods. Middle: Magnified cropped regions. Here, the ground truth has been aligned with the mip-NeRF 360 rendering, as described in Sec. 4.3. Right: Visualization of misalignment. This is the estimated optical flow between the mip-NeRF 360 rendering and the original ground truth images.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fcaf0af0-0712-4536-a33a-85763f38e6bcCited by top-tier papers12
- OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary UnderstandingYanmin Wu, Jiarui Meng, Haijie Li, Chenming Wu et al.NeurIPS 2024 · 191 citations
- 3DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion PriorsXi Liu, Chaoyi Zhou, Siyu HuangNeurIPS 2024 · 127 citations
- Masked Space-Time Hash Encoding for Efficient Dynamic Scene ReconstructionFeng Wang, Zilong Chen, Guokang Wang, Yafei Song et al.NeurIPS 2023 · 62 citations
- Cross-Ray Neural Radiance Fields for Novel-view Synthesis from Unconstrained Image CollectionsYifan Yang, Shuhai Zhang, Zixiong Huang, Yubing Zhang et al.ICCV 2023 · 61 citations
- SMERF: Streamable Memory Efficient Radiance Fields for Real-Time Large-Scene ExplorationDaniel Duckworth, Peter Hedman, Christian Reiser, Peter Zhizhin et al.SIGGRAPH 2024 · 41 citations
Builds on22
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman et al.ICCV 2021 · 2,700 citations
- CoAtNet: Marrying Convolution and Attention for All Data SizesZihang Dai, Hanxiao Liu, Quoc V. Le, Mingxing TanNeurIPS 2021 · 1,747 citations
- Neural Sparse Voxel FieldsLingjie Liu, Jiatao Gu, Kyaw Zaw Lin, Tat-Seng Chua et al.NeurIPS 2020 · 1,535 citations
- MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View StereoAnpei Chen, Zexiang Xu, Fuqiang Zhao, Xiaoshuai Zhang et al.ICCV 2021 · 1,024 citations
Related papers
- LookCloser: Frequency-aware Radiance Field for Tiny-Detail SceneXiaoyu Zhang, Weihong Pan, Chong Bao, Xiyu Zhang et al.CVPR 2025
- Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan et al.ICCV 2023 · 799 citations
- BARF: Bundle-Adjusting Neural Radiance FieldsChen-Hsuan Lin, Wei-Chiu Ma, Antonio Torralba, Simon LuceyICCV 2021 · 867 citations
- Local-to-Global Registration for Bundle-Adjusting Neural Radiance FieldsYue Chen, Xingyu Chen, Xuan Wang, Qi Zhang et al.CVPR 2023
- High-fidelity Facial Avatar Reconstruction from Monocular Video with Generative PriorsYunpeng Bai, Yanbo Fan, Xuan Wang, Yong Zhang et al.CVPR 2023
