Practical Measurements of Translucent Materials with Inter-Pixel Translucency Prior
Zhenyu Chen, Jie Guo, Shuichang Lai, Ruoyu Fu, Mengxun Kong, Chen Wang, Hongyu Sun, Zhebin Zhang, Chen Li, Yanwen Guo
Abstract
Material appearance is a key component of photorealism, with a pronounced impact on human perception. Although there are many prior works targeting at measuring opaque materials using light-weight setups (e.g., consumer-level cameras), little attention is paid on acquiring the optical properties of translucent materials which are also quite common in nature. In this paper, we present a practical method for acquiring scattering properties of translucent materials, based solely on ordinary images captured with unknown lighting and camera parameters. The key to our method is an inter-pixel translucency prior which states that image pixels of a given homogeneous translucent material typically form curves (dubbed translucent curves) in the RGB space, of which the shapes are determined by the parameters of the material. We leverage this prior in a specially-designed convolutional neural network comprising multiple encoders, a translucency-aware feature fusion module and a cascaded decoder. We demonstrate, through both visual comparisons and quantitative evaluations, that high accuracy can be achieved on a wide range of real-world translucent materials.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on5
- Path replay backpropagation: differentiating light paths using constant memory and linear timeDelio Vicini, Sébastien Speierer, Wenzel JakobSIGGRAPH 2021 · 97 citations
- Highlight-aware two-stream network for single-image SVBRDF acquisitionJie Guo, Shuichang Lai, Chengzhi Tao, Yuelong Cai et al.SIGGRAPH 2021 · 70 citations
- Monte Carlo estimators for differential light transportTizian Zeltner, Sébastien Speierer, Iliyan Georgiev, Wenzel JakobSIGGRAPH 2021 · 70 citations
- Path-space differentiable rendering of participating mediaCheng Zhang, Zihan Yu, Shuang ZhaoSIGGRAPH 2021 · 50 citations
- Two-Shot Spatially-Varying BRDF and Shape EstimationMark Boss, Varun Jampani, Kihwan Kim, Hendrik P. A. Lensch et al.CVPR 2020
Related papers
- Inverse Rendering of Translucent Objects using Physical and Neural RenderersChenhao Li, Trung Thanh Ngo, Hajime NagaharaCVPR 2023
- Learning to Transfer Heterogeneous Translucent Materials from a 2D Image to 3D ModelsXiaogang Wang, Yuhang Cheng, Ziyang Fan, Kai XuACM MM 2024 · 1 citation
- Through the Looking Glass: Neural 3D Reconstruction of Transparent ShapesZhengqin Li, Yu-Ying Yeh, Manmohan ChandrakerCVPR 2020
- Free-form scanning of non-planar appearance with neural trace photographyXiaohe Ma, Kaizhang Kang, Ruisheng Zhu, Hongzhi Wu et al.SIGGRAPH 2021 · 22 citations
- Photo-to-shape material transfer for diverse structuresRuizhen Hu, Xiangyu Su, Xiangkai Chen, Oliver van Kaick et al.SIGGRAPH 2022 · 13 citations
