Phys4DGen: Physics-Compliant 4D Generation with Multi-Material Composition Perception
Jiajing Lin, Zhenzhong Wang, Dejun Xu, Shu Jiang, Yunpeng Gong, Min Jiang
Abstract
4D content generation aims to create dynamically evolving 3D content that responds to specific input objects such as images or 3D representations. Current approaches typically incorporate physical priors to animate 3D representations, but these methods suffer from significant limitations: they not only require users lacking physics expertise to manually specify material properties but also struggle to effectively handle the generation of multi-material composite objects. To address these challenges, we propose Phys4DGen, a novel 4D generation framework that integrates multi-material composition perception with physical simulation. The framework achieves automated, physically plausible 4D generation through three innovative modules: first, the 3D Material Grouping module partitions heterogeneous material regions on 3D representations' surfaces via semantic segmentation; second, the Internal Physical Structure Discovery module constructs the mechanical structure of object interiors; finally, we distill physical prior knowledge from multimodal large language models to enable rapid and automatic material properties identification for both objects' surfaces and interiors. Experiments on both synthetic and real-world datasets demonstrate that Phys4DGen can generate high-fidelity 4D content with physical realism in open-world scenarios, significantly outperforming state-of-the-art methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c748e9cb-6acc-47ee-b205-dbf642748cc8Cited by top-tier papers12
- VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation ModelsXiangdong Zhang, Jiaqi Liao, Shaofeng Zhang, Fanqing Meng et al.NeurIPS 2025 · 98 citations
- Force Prompting: Video Generation Models Can Learn And Generalize Physics-based Control SignalsNate Gillman, Charles Herrmann, Michael Freeman, Daksh Aggarwal et al.NeurIPS 2025 · 61 citations
- Puppeteer: Rig and Animate Your 3D ModelsChaoyue Song, Xiu Li, Fan Yang, Zhongcong Xu et al.NeurIPS 2025 · 48 citations
- VoMP: Predicting Volumetric Mechanical Property FieldsRishit Dagli, Donglai Xiang, Vismay Modi, Charles Loop et al.ICLR 2026 · 13 citations
- Goal Force: Teaching Video Models To Accomplish Physics-Conditioned GoalsNate Gillman, Yinghua Zhou, Zitian Tang, Evan Luo et al.CVPR 2026 · 12 citations
Builds on28
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao et al.ICCV 2023 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 6,759 citations
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
Related papers
- PhysSplat: Efficient Physics Simulation for 3D Scenes via MLLM-Guided Gaussian SplattingHaoyu Zhao, Hao Wang, Xingyue Zhao, Hao Fei et al.ICCV 2025 · 5 citations
- Turbo4DGen: Ultra-Fast Acceleration for 4D GenerationYuanbin Man, Ying Huang, Zhile Ren, Miao YinICML 2026
- PAT3D: Physics-Augmented Text-to-3D Scene GenerationGuying Lin, Kemeng Huang, Michael Liu, Ruihan Gao et al.ICLR 2026 · 14 citations
- Phys4DRT: Physics-based 4D Generation for Real-Time Interaction with Time-Frequency SupervisionYuntian Xiao, Shoulong Zhang, Zihang Zhang, Jiahao Cui et al.ACM MM 2025
- Video Perception Models for 3D Scene SynthesisRui Huang, Guangyao Zhai, Zuria Bauer, Marc Pollefeys et al.NeurIPS 2025 · 12 citations
