Phys4DGen: Physics-Compliant 4D Generation with Multi-Material Composition Perception
Jiajing Lin, Zhenzhong Wang, Dejun Xu, Shu Jiang, Yunpeng Gong, Min Jiang
摘要
4D content generation aims to create dynamically evolving 3D content that responds to specific input objects such as images or 3D representations. Current approaches typically incorporate physical priors to animate 3D representations, but these methods suffer from significant limitations: they not only require users lacking physics expertise to manually specify material properties but also struggle to effectively handle the generation of multi-material composite objects. To address these challenges, we propose Phys4DGen, a novel 4D generation framework that integrates multi-material composition perception with physical simulation. The framework achieves automated, physically plausible 4D generation through three innovative modules: first, the 3D Material Grouping module partitions heterogeneous material regions on 3D representations' surfaces via semantic segmentation; second, the Internal Physical Structure Discovery module constructs the mechanical structure of object interiors; finally, we distill physical prior knowledge from multimodal large language models to enable rapid and automatic material properties identification for both objects' surfaces and interiors. Experiments on both synthetic and real-world datasets demonstrate that Phys4DGen can generate high-fidelity 4D content with physical realism in open-world scenarios, significantly outperforming state-of-the-art methods.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper12
- VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation ModelsXiangdong Zhang, Jiaqi Liao, Shaofeng Zhang, Fanqing Meng 等NeurIPS 2025 · 被引用 98 次
- Force Prompting: Video Generation Models Can Learn And Generalize Physics-based Control SignalsNate Gillman, Charles Herrmann, Michael Freeman, Daksh Aggarwal 等NeurIPS 2025 · 被引用 61 次
- Puppeteer: Rig and Animate Your 3D ModelsChaoyue Song, Xiu Li, Fan Yang, Zhongcong Xu 等NeurIPS 2025 · 被引用 48 次
- VoMP: Predicting Volumetric Mechanical Property FieldsRishit Dagli, Donglai Xiang, Vismay Modi, Charles Loop 等ICLR 2026 · 被引用 13 次
- Goal Force: Teaching Video Models To Accomplish Physics-Conditioned GoalsNate Gillman, Yinghua Zhou, Zitian Tang, Evan Luo 等CVPR 2026 · 被引用 12 次
它引用的顶会 Paper28
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao 等ICCV 2023 · 被引用 13,211 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 被引用 6,759 次
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
相关 Paper
- PhysSplat: Efficient Physics Simulation for 3D Scenes via MLLM-Guided Gaussian SplattingHaoyu Zhao, Hao Wang, Xingyue Zhao, Hao Fei 等ICCV 2025 · 被引用 5 次
- Turbo4DGen: Ultra-Fast Acceleration for 4D GenerationYuanbin Man, Ying Huang, Zhile Ren, Miao YinICML 2026
- PAT3D: Physics-Augmented Text-to-3D Scene GenerationGuying Lin, Kemeng Huang, Michael Liu, Ruihan Gao 等ICLR 2026 · 被引用 14 次
- Phys4DRT: Physics-based 4D Generation for Real-Time Interaction with Time-Frequency SupervisionYuntian Xiao, Shoulong Zhang, Zihang Zhang, Jiahao Cui 等ACM MM 2025
- Video Perception Models for 3D Scene SynthesisRui Huang, Guangyao Zhai, Zuria Bauer, Marc Pollefeys 等NeurIPS 2025 · 被引用 12 次
