UCLID-Net: Single View Reconstruction in Object Space
Benoît Guillard, Edoardo Remelli, Pascal Fua
Abstract
Most state-of-the-art deep geometric learning single-view reconstruction approaches rely on encoder-decoder architectures that output either shape parametrizations [7, 8, 21] or implicit representations [14, 24, 4] . However, these representations rarely preserve the Euclidean structure of the 3D space objects exist in. In this paper, we show that building a geometry preserving 3-dimensional latent space helps the network concurrently learn global shape regularities and local reasoning in the object coordinate space and, as a result, boosts performance. We demonstrate both on ShapeNet synthetic images, which are often used for benchmarking purposes, and on real-world images that our approach outperforms state-of-the-art ones. Furthermore, the single-view pipeline naturally extends to multi-view reconstruction, which we also show.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9ec0dd20-bd78-45f4-a225-4e5634912f44Cited by top-tier papers3
- Sketch2Mesh: Reconstructing and Editing 3D Shapes from SketchesBenoît Guillard, Edoardo Remelli, Pierre Yvernay, Pascal FuaICCV 2021 · 102 citations
- Voxel-based 3D Detection and Reconstruction of Multiple Objects from a Single ImageFeng Liu, Xiaoming LiuNeurIPS 2021 · 43 citations
- BUOL: A Bottom-Up Framework with Occupancy-Aware Lifting for Panoptic 3D Scene Reconstruction From a Single ImageTao Chu, Pan Zhang, Qiong Liu, Jiaqi WangCVPR 2023
Builds on2
Related papers
- Higher-Order Function Networks for Learning Composable 3D Object RepresentationsEric Mitchell, Selim Engin, Volkan Isler, Daniel D. LeeICLR 2020 · 23 citations
- From Image Collections to Point Clouds With Self-Supervised Shape and Pose NetworksNavaneet K. L., Ansu Mathew, Shashank Kashyap, Wei-Chih Hung et al.CVPR 2020
- Single Image Shape-from-SilhouettesYawen Lu, Yuxing Wang, Guoyu LuACM MM 2020 · 6 citations
- Equivariant Neural RenderingEmilien Dupont, Miguel Bautista Martin, Alex Colburn, Aditya Sankar et al.ICML 2020 · 69 citations
- Local Implicit Grid Representations for 3D ScenesChiyu Max Jiang, Avneesh Sud, Ameesh Makadia, Jingwei Huang et al.CVPR 2020
