PaletteNeRF: Palette-based Appearance Editing of Neural Radiance Fields
Zhengfei Kuang, Fujun Luan, Sai Bi, Zhixin Shu, Gordon Wetzstein, Kalyan Sunkavalli
Abstract
View #1 Style Transfer (c) Recoloring Illumination Editing (d) Applications View #2 View #1 View #2 Figure 1. We propose PaletteNeRF, a novel method for efficient appearance editing of neural radiance fields (NeRF). Taking (a) multi-view photos as training input, our approach reconstructs a NeRF and decomposes its appearance into a set of (b) 3D palette-based color bases. This enables (c) intuitive and photorealistic recoloring of the scene with 3D consistency across arbitrary views. Further, we show that (d) our method supports various palette-based editing applications such as illumination modification and 3D photorealistic style transfer.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9cf72b69-facd-4839-92ad-4e4846bcf818Cited by top-tier papers30
- StopThePop: Sorted Gaussian Splatting for View-Consistent Real-time RenderingLukas Radl, Michael Steiner, Mathias Parger, Alexander Weinrauch et al.SIGGRAPH 2024 · 93 citations
- SKED: Sketch-guided Text-based 3D EditingAryan Mikaeili, Or Perel, Mehdi Safaee, Daniel Cohen-Or et al.ICCV 2023 · 83 citations
- Reference-guided Controllable Inpainting of Neural Radiance FieldsAshkan Mirzaei, Tristan Aumentado-Armstrong, Marcus A. Brubaker, Jonathan Kelly et al.ICCV 2023 · 49 citations
- RecolorNeRF: Layer Decomposed Radiance Fields for Efficient Color Editing of 3D ScenesBingchen Gong, Yuehao Wang, Xiaoguang Han, Qi DouACM MM 2023 · 25 citations
- Seal-3D: Interactive Pixel-Level Editing for Neural Radiance FieldsXiangyu Wang, Jingsen Zhu, Qi Ye, Yuchi Huo et al.ICCV 2023 · 24 citations
Builds on18
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan et al.CVPR 2022 · 1,603 citations
- Volume Rendering of Neural Implicit SurfacesLior Yariv, Jiatao Gu, Yoni Kasten, Yaron LipmanNeurIPS 2021 · 1,421 citations
- Plenoxels: Radiance Fields without Neural NetworksSara Fridovich-Keil, Alex Yu, Matthew Tancik, Qinhong Chen et al.CVPR 2022 · 1,237 citations
- KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPsChristian Reiser, Songyou Peng, Yiyi Liao, Andreas GeigerICCV 2021 · 963 citations
Related papers
- LAENeRF: Local Appearance Editing for Neural Radiance FieldsLukas Radl, Michael Steiner, Andreas Kurz, Markus SteinbergerCVPR 2024 · 6 citations
- DE-NeRF: DEcoupled Neural Radiance Fields for View-Consistent Appearance Editing and High-Frequency Environmental RelightingTong Wu, Jia-Mu Sun, Yu-Kun Lai, Lin GaoSIGGRAPH 2023 · 30 citations
- StyleNeRF: A Style-based 3D Aware Generator for High-resolution Image SynthesisJiatao Gu, Lingjie Liu, Peng Wang, Christian TheobaltICLR 2022 · 622 citations
- StyleRF-VolVis: Style Transfer of Neural Radiance Fields for Expressive Volume VisualizationKaiyuan Tang, Chaoli WangIEEE VIS 2024 · 11 citations
- NeRF Analogies: Example-Based Visual Attribute Transfer for NeRFsMichael Fischer, Zhengqin Li, Thu Nguyen-Phuoc, Aljaz Bozic et al.CVPR 2024
