Unsupervised Learning of Depth and Depth-of-Field Effect From Natural Images With Aperture Rendering Generative Adversarial Networks
Takuhiro Kaneko
Abstract
Figure 1. Unsupervised learning of depth and depth-of-field (DoF) effect from unlabeled natural images. (a) In training, we adopt only a collection of single-DoF images without any additional supervision (e.g., ground-truth depth, pairs of deep and shallow DoF images, and pretrained model). (b) Once trained, our model can synthesize tuples of deep and shallow DoF images and depths from random noise. The generated data are beneficial in training a shallow DoF renderer, which also requires no external supervision.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4ec4d0e3-97c0-4c2a-80e8-68dd8c1b6a0dCited by top-tier papers4
- GlowGAN: Unsupervised Learning of HDR Images from LDR Images in the WildChao Wang, Ana Serrano, Xingang Pan, Bin Chen et al.ICCV 2023 · 29 citations
- AR-NeRF: Unsupervised Learning of Depth and Defocus Effects from Natural Images with Aperture Rendering Neural Radiance FieldsTakuhiro KanekoCVPR 2022 · 13 citations
- Dr.Bokeh: DiffeRentiable Occlusion-Aware Bokeh RenderingYichen Sheng, Zixun Yu, Lu Ling, Zhiwen Cao et al.CVPR 2024 · 9 citations
- Any-to-Bokeh: Arbitrary-Subject Video Refocusing with Video Diffusion ModelYang Yang, Siming Zheng, Qirui Yang, Jinwei Chen et al.ICLR 2026 · 1 citation
Builds on8
- Differentiable Augmentation for Data-Efficient GAN TrainingShengyu Zhao, Zhijian Liu, Ji Lin, Jun-Yan Zhu et al.NeurIPS 2020 · 707 citations
- RGBD-GAN: Unsupervised 3D Representation Learning From Natural Image Datasets via RGBD Image SynthesisAtsuhiro Noguchi, Tatsuya HaradaICLR 2020 · 30 citations
- Unsupervised Learning of Probably Symmetric Deformable 3D Objects From Images in the WildShangzhe Wu, Christian Rupprecht, Andrea VedaldiCVPR 2020
- Blur, Noise, and Compression Robust Generative Adversarial NetworksTakuhiro Kaneko, Tatsuya HaradaCVPR 2021
- Noise Robust Generative Adversarial NetworksTakuhiro Kaneko, Tatsuya HaradaCVPR 2020
Related papers
- Lens Parameter Estimation for Realistic Depth of Field ModelingDominique Piché-Meunier, Yannick Hold-Geoffroy, Jianming Zhang, Jean-François LalondeICCV 2023 · 3 citations
- DC2: Dual-Camera Defocus Control by Learning to RefocusHadi Alzayer, Abdullah Abuolaim, Leung Chun Chan, Yang Yang et al.CVPR 2023
- DoF-NeRF: Depth-of-Field Meets Neural Radiance FieldsZijin Wu, Xingyi Li, Juewen Peng, Hao Lu et al.ACM MM 2022 · 34 citations
- BokehFlow: Depth-Free Controllable Bokeh Rendering via Flow MatchingYachuan Huang, Xianrui Luo, Qiwen Wang, Liao Shen et al.AAAI 2026 · 2 citations
- Fully Self-Supervised Depth Estimation from Defocus ClueHaozhe Si, Bin Zhao, Dong Wang, Yunpeng Gao et al.CVPR 2023
