Transferring Causal Driving Patterns for Generalizable Traffic Simulation with Diffusion-Based Distillation
Yuhang Chen, Jie Sun, Jialin Fan, Jian Sun
Abstract
Traffic simulation is essential for validating the safety and reliability of autonomous driving systems, yet data-driven simulation methods often struggle with distribution shifts, limiting their generalizability across diverse datasets (domains). To address this, we present Causal Driving Pattern Transfer (CDPT), a novel two-stage knowledge distillation framework built upon diffusion model to enhance cross-domain generalizability. In Phase I, we implement hybrid self-distillation within the source domain by integrating feature-, response-, and contrastive-level distillation, which enables the model to decompose complex driving behaviors into their core causal components, including scene-conditioned driven patterns, multi-agent interaction dynamics and casual saliency. In Phase II, we introduce a continual distillation strategy: few-shot samples from the target domain are used to initiate generation of diverse synthetic scenarios, allowing the student model to continually adapt to novel environments without retraining on large-scale data. Extensive experiments demonstrate that CDPT achieves strong generalization in both open-loop and closed-loop simulations, effectively generating realistic, interaction-aware behaviors that are critical for scalable and reliable autonomous driving testing.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6befec94-90b2-4c58-ad1a-b285c22d996fBuilds on7
- Improved Denoising Diffusion Probabilistic ModelsAlexander Quinn Nichol, Prafulla DhariwalICML 2021 · 5,234 citations
- SMART: Scalable Multi-agent Real-time Motion Generation via Next-token PredictionWei Wu, Xiaoxin Feng, Ziyan Gao, Yuheng KanNeurIPS 2024 · 104 citations
- SceneDiffuser: Efficient and Controllable Driving Simulation Initialization and RolloutChiyu Max Jiang, Yijing Bai, Andre Cornman, Christopher Davis et al.NeurIPS 2024 · 76 citations
- BehaviorGPT: Smart Agent Simulation for Autonomous Driving with Next-Patch PredictionZikang Zhou, Haibo Hu, Xinhong Chen, Jianping Wang et al.NeurIPS 2024 · 73 citations
- How many Observations are Enough? Knowledge Distillation for Trajectory ForecastingAlessio Monti, Angelo Porrello, Simone Calderara, Pasquale Coscia et al.CVPR 2022 · 62 citations
Related papers
- Learning Causal Domain-Invariant Temporal Dynamics for Few-Shot Action RecognitionYuke Li, Guangyi Chen, Ben Abramowitz, Stefano Anzellotti et al.ICML 2024 · 3 citations
- Uncertainty-Guided Never-Ending Learning to DriveLei Lai, Eshed Ohn-Bar, Sanjay Arora, John Seon Keun YiCVPR 2024
- RLFTSim: Realistic and Controllable Multi-Agent Traffic Simulation via Reinforcement Learning Fine-TuningEhsan Ahmadi, Hunter Schofield, Behzad Khamidehi, Fazel Arasteh et al.CVPR 2026 · 2 citations
- Cross-Domain Correlation Distillation for Unsupervised Domain Adaptation in Nighttime Semantic SegmentationHuan Gao, Jichang Guo, Guoli Wang, Qian ZhangCVPR 2022 · 82 citations
- Domain Randomization and Pyramid Consistency: Simulation-to-Real Generalization Without Accessing Target Domain DataXiangyu Yue, Yang Zhang, Sicheng Zhao, Alberto L. Sangiovanni-Vincentelli et al.ICCV 2019 · 462 citations
