PhyScene3D: Physically Consistent 3D Interactive Tabletop Scene Generation
Weixing Chen, Zhuoqian Feng, Yang Liu, Yexin Zhang, Yifan Wen, Yinghong Liao, Weichao Qiu, Guanbin Li, Liang Lin
摘要
Generating physically consistent 3D tabletop scenes is a fundamental yet underexplored problem for interactive and generalist robotic learning. The challenge stems from dense object hierarchies and irregular affordances. Here, an interactive scene denotes a physically valid, collision-free environment directly loadable into physics simulators. Existing methods, ranging from decoupled symbolic solvers to end-to-end regression models, often suffer from error propagation or overfitting to noisy supervision containing widespread physical violations. To address these limitations, we introduce PhyScene3D, a framework that reformulates generation as a Human-Mimetic Constructive Process. The proposed Cognitive Topological Reasoning Chain (CTRC) factorizes scene synthesis into a sequential, anchor-conditioned process. It employs a 3D AABB-based placement scheme that imposes a strong structural inductive bias. To address imperfect supervision and physical infeasibility, we introduce Physics-Aware Denoising Alignment (PADA). It integrates a differentiable Signed Distance Field (SDF) with Test-Time Optimization (TTO) to project generated scenes onto a physics-feasible manifold while preserving semantic intent. Experiments demonstrate that PhyScene3D outperforms stateof-the-art approaches in both semantic accuracy and physical validity, achieving a 40% reduction in scene-wise collision rate relative to the humanannotated training data. PhyScene3D: Physically Consistent Interactive 3D Tabletop Scene Generation Cognitive Topological Reasoning Chain Physics-Aware Denoising Alignment Generate some Office Table scenes A desktop featuring a desk lamp, four books, a bowl containing some fruit, and of course a cup of coffee.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper10
- PaLM-E: An Embodied Multimodal Language ModelDanny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch 等ICML 2023 · 被引用 2,601 次
- Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language ModelsSiddharth Karamcheti, Suraj Nair, Ashwin Balakrishna, Percy Liang 等ICML 2024 · 被引用 306 次
- RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative SimulationYufei Wang, Zhou Xian, Feng Chen, Tsun-Hsuan Wang 等ICML 2024 · 被引用 227 次
- Scenethesis: A Language and Vision Agentic Framework for 3D Scene GenerationLu Ling, Chen-Hsuan Lin, Tsung-Yi Lin, Yifan Ding 等ICLR 2026 · 被引用 74 次
- Infinigen Indoors: Photorealistic Indoor Scenes using Procedural GenerationAlexander Raistrick, Lingjie Mei, Karhan Kayan, David Yan 等CVPR 2024 · 被引用 24 次
相关 Paper
- PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIYandan Yang, Baoxiong Jia, Peiyuan Zhi, Siyuan HuangCVPR 2024 · 被引用 27 次
- STABLE: Simulation-Ready Tabletop Layout Generation via a Semantics–Physics Dual SystemZhen Luo, Yixuan Yang, Xudong XU, Jinkun Hao 等ICML 2026
- PAT3D: Physics-Augmented Text-to-3D Scene GenerationGuying Lin, Kemeng Huang, Michael Liu, Ruihan Gao 等ICLR 2026 · 被引用 14 次
- SPREAD: Spatial-Physical REasoning via geometry Aware DiffusionMinzhang Li, Kuixiang Shao, Xuebing Li, Yuyang Jiao 等CVPR 2026
- Physics-based Scene Layout Generation from Human MotionJianan Li, Tao Huang, Qingxu Zhu, Tien-Tsin WongSIGGRAPH 2024 · 被引用 5 次
