GHOST: Geometry-Guided Hallucination of Opaque Surface Textures
Langxu Zhao, Zuan Gu, Tianhan Gao
Abstract
Transparent objects pose a fundamental challenge for depth estimation and 3D reconstruction due to their violation of Lambertian assumptions, leading to severe geometry degradation in downstream tasks. To address this, we propose a novel geometry-guided preprocessing framework GHOST that leverages visual foundation models to transform transparent regions into opaque, structurally consistent representations without requiring downstream model retraining. Specifically, our pipeline utilizes (1) TransDINO and (2) TransDecomp to disentangle masks and transparency physical properties, while (3) DAF-Net recovers surface normal priors to encode geometric curvature. Subsequently, (4) GeoSem-TransNet integrates these multi-modal cues to synthesize a texture-rich opaque RGB image that preserves the transparent object's 3D structure. Extensive experiments demonstrate that our method significantly enhances the accuracy of state-of-the-art depth estimation and reconstruction models on transparent objects by restoring essential photometric cues.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5e7d8a99-c918-440c-8ad6-3134e64f31e2Builds on9
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- Free-Form Image Inpainting With Gated ConvolutionJiahui Yu, Zhe Lin, Jimei Yang, Xiaohui Shen et al.ICCV 2019 · 1,990 citations
- Depth Anything 3: Recovering the Visual Space from Any ViewsHaotong Lin, Sili Chen, Jun Hao Liew, Donny Y. Chen et al.ICLR 2026 · 720 citations
- DUSt3R: Geometric 3D Vision Made EasyShuzhe Wang, Vincent Leroy, Yohann Cabon, Boris Chidlovskii et al.CVPR 2024 · 302 citations
- Enhanced Boundary Learning for Glass-like Object SegmentationHao He, Xiangtai Li, Guangliang Cheng, Jianping Shi et al.ICCV 2021 · 107 citations
Related papers
- TransNormal: Dense Visual Semantics for Diffusion-based Transparent Object Normal EstimationMingwei Li, Hehe Fan, Yi YangICML 2026 · 1 citation
- TSPE-GS: Probabilistic Depth Extraction for Semi-Transparent Surface Reconstruction via 3D Gaussian SplattingZhiyuan Xu, Nan Min, Yuhang Guo, Tong WeiAAAI 2026
- TSGS: Improving Gaussian Splatting for Transparent Surface Reconstruction via Normal and De-lighting PriorsMingwei Li, Pu Pang, Hehe Fan, Hua Huang et al.ACM MM 2025 · 6 citations
- Through the Looking Glass: Neural 3D Reconstruction of Transparent ShapesZhengqin Li, Yu-Ying Yeh, Manmohan ChandrakerCVPR 2020
- Consistent Depth Prediction for Transparent Object Reconstruction from RGB-D CameraYuxiang Cai, Yifan Zhu, Haiwei Zhang, Bo RenICCV 2023 · 10 citations
