Orientation Matters: Making 3D Generative Models Orientation-Aligned
Yichong Lu, Yuzhuo Tian, Zijin Jiang, Yikun Zhao, Yuanbo Yang, Hao Ouyang, Haoji Hu, Huimin Yu, Yujun Shen, Yiyi Liao
摘要
Humans intuitively perceive object shape and orientation from a single image, guided by strong priors about canonical poses. However, existing 3D generative models often produce misaligned results due to inconsistent training data, limiting their usability in downstream tasks. To address this gap, we introduce the task of orientation-aligned 3D object generation: producing 3D objects from single images with consistent orientations across categories. To facilitate this, we construct Objaverse-OA, a dataset of 14,832 orientation-aligned 3D models spanning 1,008 categories. Leveraging Objaverse-OA, we fine-tune two representative 3D generative models based on multi-view diffusion and 3D variational autoencoder frameworks to produce aligned objects that generalize well to unseen objects across various categories. Experimental results demonstrate the superiority of our method over post-hoc alignment approaches. Furthermore, we showcase downstream applications enabled by our aligned object generation, including zero-shot object orientation estimation via analysis-by-synthesis and efficient arrow-based object rotation manipulation.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- CUPID: Generative 3D Reconstruction via Joint Object and Pose ModelingBinbin Huang, Haobin Duan, Yiqun Zhao, Zibo Zhao 等CVPR 2026 · 被引用 8 次
- VIAFormer: Voxel-Image Alignment Transformer for High-Fidelity Voxel RefinementTiancheng Fang, Bowen Pan, Lingxi Chen, Jiangjing Lyu 等CVPR 2026 · 被引用 1 次
它引用的顶会 Paper31
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view ReconstructionPeng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt 等NeurIPS 2021 · 被引用 2,500 次
相关 Paper
- One-shot 3D Object Canonicalization based on Geometric and Semantic ConsistencyLi Jin, Yujie Wang, Wenzheng Chen, Qiyu Dai 等CVPR 2025
- SPAD: Spatially Aware Multi-View DiffusersYash Kant, Aliaksandr Siarohin, Ziyi Wu, Michael Vasilkovsky 等CVPR 2024
- From One to More: Contextual Part Latents for 3D GenerationShaocong Dong, Lihe Ding, Xiao Chen, Yaokun Li 等ICCV 2025 · 被引用 4 次
- Gaussian Variation Field Diffusion for High-Fidelity Video-to-4D SynthesisBowen Zhang, Sicheng Xu, Chuxin Wang, Jiaolong Yang 等ICCV 2025 · 被引用 4 次
- MVReward: Better Aligning and Evaluating Multi-View Diffusion Models with Human PreferencesWeitao Wang, Haoran Xu, Yuxiao Yang, Zhifang Liu 等AAAI 2025 · 被引用 9 次
