PPISP: Physically-Plausible Compensation and Control of Photometric Variations in Radiance Field Reconstruction
Isaac Deutsch, Nicolas Moënne-Loccoz, Gavriel State, Žan Gojčič
Abstract
Multi-view 3D reconstruction methods remain highly sensitive to photometric inconsistencies arising from camera optical characteristics and variations in image signal processing (ISP). Existing mitigation strategies such as per-frame latent variables or affine color corrections lack physical grounding and generalize poorly to novel views. We propose the Physically-Plausible ISP (PPISP) correction module, which disentangles camera-intrinsic and capture-dependent effects through physically based and interpretable transformations. A dedicated PPISP controller, trained on the input views, predicts ISP parameters for novel viewpoints, analogous to auto exposure and auto white balance in real cameras. This design enables realistic and fair evaluation on novel views without access to ground-truth images. PPISP achieves SoTA performance on standard benchmarks, while providing intuitive control and supporting the integration of metadata when available.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2ce53ef2-9ad4-4d52-ac23-958ca8babb8dCited by top-tier papers1
Ask how each one uses itBuilds on19
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan et al.CVPR 2022 · 1,603 citations
- Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan et al.ICCV 2023 · 799 citations
- Block-NeRF: Scalable Large Scene Neural View SynthesisMatthew Tancik, Vincent Casser, Xinchen Yan, Sabeek Pradhan et al.CVPR 2022 · 702 citations
- NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw ImagesBen Mildenhall, Peter Hedman, Ricardo Martin-Brualla, Pratul P. Srinivasan et al.CVPR 2022 · 307 citations
Related papers
- CHROMA: Consistent Harmonization of Multi-View Appearance via Bilateral Grid PredictionJisu Shin, Richard Shaw, Seunghyun Shin, Zhensong Zhang et al.ICLR 2026 · 4 citations
- Generalizing ISP Model by Unsupervised Raw-to-raw MappingDongyu Xie, Chaofan Qiao, Lanyue Liang, Zhiwen Wang et al.ACM MM 2024 · 5 citations
- Bilateral Guided Radiance Field ProcessingYuehao Wang, Chaoyi Wang, Bingchen Gong, Tianfan XueSIGGRAPH 2024 · 12 citations
- A Multi-Hypothesis Approach to Color ConstancyDaniel Hernández Juárez, Sarah Parisot, Benjamin Busam, Ales Leonardis et al.CVPR 2020
- Learning Image Harmonization in the Linear Color SpaceKe Xu, Gerhard Petrus Hancke, Rynson W. H. LauICCV 2023 · 9 citations
