SuperMat: Physically Consistent PBR Material Estimation at Interactive Rates
Yijia Hong, Yuan-Chen Guo, Ran Yi, Yulong Chen, Yan-Pei Cao, Lizhuang Ma
Abstract
Decomposing physically-based materials from images into their constituent properties remains challenging, particularly when maintaining both computational efficiency and physical consistency. While recent diffusion-based approaches have shown promise, they face substantial computational overhead due to multiple denoising steps and separate models for different material properties. We present SuperMat, a single-step framework that achieves high-quality material decomposition with one-step inference. This enables end-to-end training with perceptual and re-render losses while decomposing albedo, metallic, and roughness maps at millisecond-scale speeds. We further extend our framework to 3D objects through a UV refinement network, enabling consistent material estimation across viewpoints while maintaining efficiency. Experiments demonstrate that SuperMat achieves state-of-the-art PBR material decomposition quality while reducing inference time from seconds to milliseconds per image, and completes PBR material estimation for 3D objects in approximately 3 seconds. The project page is at https://hyj542682306.github.io/SuperMat/.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers4
- Lafite: A Generative Latent Field for 3D Native TexturingChia-Hao Chen, Yuan-Chen Guo, Zi-Xin Zou, Ze Yuan et al.CVPR 2026 · 6 citations
- LumiTex: Towards High-Fidelity PBR Texture Generation with Illumination ContextJingzhi Bao, Hongze Chen, Lingting Zhu, Chenyu Liu et al.ICLR 2026 · 3 citations
- MaterialMVP: Illumination-Invariant Material Generation via Multi-View PBR DiffusionZebin He, Mingxin Yang, Shuhui Yang, Yixuan Tang et al.ICCV 2025 · 3 citations
- WildCap: Facial Albedo Capture in the Wild via Hybrid Inverse RenderingYuxuan Han, Xin Ming, Tianxiao Li, Zhuofan Shen et al.CVPR 2026 · 1 citation
Builds on34
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score DistillationZhengyi Wang, Cheng Lu, Yikai Wang, Fan Bao et al.NeurIPS 2023 · 1,498 citations
- MVDream: Multi-view Diffusion for 3D GenerationYichun Shi, Peng Wang, Jianglong Ye, Long Mai et al.ICLR 2024 · 973 citations
- Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content CreationRui Chen, Yongwei Chen, Ningxin Jiao, Kui JiaICCV 2023 · 769 citations
- DreamFusion: Text-to-3D using 2D DiffusionBen Poole, Ajay Jain, Jonathan T. Barron, Ben MildenhallICLR 2023 · 463 citations
Related papers
- DualMat: PBR Material Estimation via Coherent Dual-Path DiffusionYifeng Huang, Zhang Chen, Yi Xu, Minh Hoai et al.ACM MM 2025
- MatMart: Material Reconstruction of 3D Objects via DiffusionXiuchao Wu, Pengfei Zhu, Jiangjing Lyu, Xinguo Liu et al.CVPR 2026 · 2 citations
- DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion ModelsYuqing Zhang, Yuan Liu, Zhiyu Xie, Lei Yang et al.SIGGRAPH 2024 · 28 citations
- Material Palette: Extraction of Materials from a Single ImageIvan Lopes, Fabio Pizzati, Raoul de CharetteCVPR 2024 · 14 citations
- MatE: Material Extraction from Single-Image via Geometric PriorZeyu Zhang, Wei Zhai, Jian Yang, Yang CaoCVPR 2026
