Causal Composition Diffusion Model for Closed-loop Traffic Generation
Haohong Lin, Xin Huang, Tung Phan, David S. Hayden, Huan Zhang, Ding Zhao, Siddhartha S. Srinivasa, Eric M. Wolff, Hongge Chen
Abstract
Simulation is critical for safety evaluation in autonomous driving, particularly in capturing complex interactive behaviors. However, generating realistic and controllable traffic scenarios in long-tail situations remains a significant challenge. Existing generative models suffer from the conflicting objective between user-defined controllability and realism constraints, which is amplified in safety-critical contexts. In this work, we introduce the Causal Compositional Diffusion Model (CCDiff), a structure-guided diffusion framework to address these challenges. We first formulate the learning of controllable and realistic closed-loop simulation as a constrained optimization problem. Then, CCDiff maximizes controllability while adhering to realism by automatically identifying and injecting causal structures directly into the diffusion process, providing structured guidance to enhance both realism and controllability. Through rigorous evaluations on benchmark datasets and in a closed-loop simulator, CCDiff demonstrates substantial gains over state-of-the-art approaches in generating realistic and user-preferred trajectories. Our results show CCDiff's effectiveness in extracting and leveraging causal structures, showing improved closedloop performance based on key metrics such as collision rate, off-road rate, FDE, and comfort. For more details, welcome to check our project website.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 38b935bd-cb6b-4e9c-82a1-d3f20341667dCited by top-tier papers4
- Generative Trajectory Stitching through Diffusion CompositionYunhao Luo, Utkarsh A. Mishra, Yilun Du, Danfei XuNeurIPS 2025 · 48 citations
- VILTA: A VLM-in-the-Loop Adversary for Enhancing Driving Policy RobustnessQimao Chen, Fang Li, Shaoqing Xu, Zhiyi Lai et al.AAAI 2026 · 2 citations
- Clinically-Grounded Counterfactual Reasoning for Medical Video DiagnosisJianzhe Gao, Churan Wang, Weiyi Zhang, Jianghua Li et al.CVPR 2026
- VectorWorld: Efficient Streaming World Model via Diffusion Flow on Vector GraphsChaokang Jiang, Desen Zhou, Jiuming Liu, Li SunICML 2026
Builds on21
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Gradient Surgery for Multi-Task LearningTianhe Yu, Saurabh Kumar, Abhishek Gupta, Sergey Levine et al.NeurIPS 2020 · 2,261 citations
- Planning with Diffusion for Flexible Behavior SynthesisMichael Janner, Yilun Du, Joshua B. Tenenbaum, Sergey LevineICML 2022 · 1,115 citations
- Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion DatasetScott Ettinger, Shuyang Cheng, Benjamin Caine, Chenxi Liu et al.ICCV 2021 · 817 citations
- HiVT: Hierarchical Vector Transformer for Multi-Agent Motion PredictionZikang Zhou, Luyao Ye, Jianping Wang, Kui Wu et al.CVPR 2022 · 379 citations
Related papers
- SceneDiffuser: Efficient and Controllable Driving Simulation Initialization and RolloutChiyu Max Jiang, Yijing Bai, Andre Cornman, Christopher Davis et al.NeurIPS 2024 · 76 citations
- LangTraj: Diffusion Model and Dataset for Language-Conditioned Trajectory SimulationWei-Jer Chang, Wei Zhan, Masayoshi Tomizuka, Manmohan Chandraker et al.ICCV 2025 · 5 citations
- Scenario Diffusion: Controllable Driving Scenario Generation With DiffusionEthan Pronovost, Meghana Reddy Ganesina, Noureldin Hendy, Zeyu Wang et al.NeurIPS 2023 · 89 citations
- Model-Based Policy Adaptation for Closed-Loop End-to-end Autonomous DrivingHaohong Lin, Yunzhi Zhang, Wenhao Ding, Jiajun Wu et al.NeurIPS 2025 · 11 citations
- Driving View Synthesis on Free-Form Trajectories with Generative PriorZeyu Yang, Zijie Pan, Yuankun Yang, Xiatian Zhu et al.ICCV 2025 · 3 citations
