ABO: Dataset and Benchmarks for Real-World 3D Object Understanding
Jasmine Collins, Shubham Goel, Kenan Deng, Achleshwar Luthra, Leon Xu, Erhan Gundogdu, Xi Zhang, Tomas F. Yago Vicente, Thomas Dideriksen, Himanshu Arora, Matthieu Guillaumin, Jitendra Malik
Abstract
We introduce Amazon Berkeley Objects (ABO), a new large-scale dataset designed to help bridge the gap between real and virtual 3D worlds. ABO contains product catalog images, metadata, and artist-created 3D models with com-plex geometries and physically-based materials that cor-respond to real, household objects. We derive challenging benchmarks that exploit the unique properties of ABO and measure the current limits of the state-of-the-art on three open problems for real-world 3D object understanding: single-view 3D reconstruction, material estimation, and cross-domain multi-view object retrieval.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f657dc86-6744-450e-81ca-53d9897d880aCited by top-tier papers155
- LRM: Large Reconstruction Model for Single Image to 3DYicong Hong, Kai Zhang, Jiuxiang Gu, Sai Bi et al.ICLR 2024 · 813 citations
- 🏘️ ProcTHOR: Large-Scale Embodied AI Using Procedural GenerationMatt Deitke, Eli VanderBilt, Alvaro Herrasti, Luca Weihs et al.NeurIPS 2022 · 596 citations
- OpenShape: Scaling Up 3D Shape Representation Towards Open-World UnderstandingMinghua Liu, Ruoxi Shi, Kaiming Kuang, Yinhao Zhu et al.NeurIPS 2023 · 267 citations
- DMV3D: Denoising Multi-view Diffusion Using 3D Large Reconstruction ModelYinghao Xu, Hao Tan, Fujun Luan, Sai Bi et al.ICLR 2024 · 234 citations
- Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and ReconstructionHansheng Chen, Jiatao Gu, Anpei Chen, Wei Tian et al.ICCV 2023 · 213 citations
Builds on8
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category ReconstructionJeremy Reizenstein, Roman Shapovalov, Philipp Henzler, Luca Sbordone et al.ICCV 2021 · 686 citations
- Pix2Vox: Context-Aware 3D Reconstruction From Single and Multi-View ImagesHaozhe Xie, Hongxun Yao, Xiaoshuai Sun, Shangchen Zhou et al.ICCV 2019 · 373 citations
- Deep 3D Capture: Geometry and Reflectance From Sparse Multi-View ImagesSai Bi, Zexiang Xu, Kalyan Sunkavalli, David J. Kriegman et al.CVPR 2020
- Two-Shot Spatially-Varying BRDF and Shape EstimationMark Boss, Varun Jampani, Kihwan Kim, Hendrik P. A. Lensch et al.CVPR 2020
Related papers
- An Extensible Multi-modal Multi-task Object Dataset with MaterialsTrevor Scott Standley, Ruohan Gao, Dawn Chen, Jiajun Wu et al.ICLR 2023
- 3DReflecNet: A Large-Scale Dataset for 3D Reconstruction of Reflective, Transparent, and Low-Texture ObjectsZhicheng Liang, Haoyi Yu, Boyan Li, Dayou Zhang et al.CVPR 2026 · 1 citation
- OASIS: A Large-Scale Dataset for Single Image 3D in the WildWeifeng Chen, Shengyi Qian, David Fan, Noriyuki Kojima et al.CVPR 2020
- DiLiGenT102: A Photometric Stereo Benchmark Dataset with Controlled Shape and Material VariationJieji Ren, Feishi Wang, Jiahao Zhang, Qian Zheng et al.CVPR 2022 · 26 citations
- Pretrain, Self-train, Distill: A simple recipe for Supersizing 3D ReconstructionKalyan Vasudev Alwala, Abhinav Gupta, Shubham TulsianiCVPR 2022 · 23 citations
