S2Q-VDiT: Accurate Quantized Video Diffusion Transformer with Salient Data and Sparse Token Distillation
Weilun Feng, Haotong Qin, Chuanguang Yang, Xiangqi Li, Han Yang, Yuqi Li, Zhulin An, Libo Huang, Michele Magno, Yongjun Xu
2025Year
1Citations
3Top-tier citations
Abstract
a stylish woman walks down a Tokyo street filled with warm glowing neon and animated city signage.
Figure 1: We present S 2 Q-VDiT, a post-training quantization method for video diffusion transformers. We quantize HunyuanVideo [24] to 4-bit weights and 6-bit activations without compromising visual quality. S 2 Q-VDiT can further achieve 3.9× model compression and 1.3× inference acceleration.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- Quantized Visual Geometry Grounded TransformerWeilun Feng, Haotong Qin, Mingqiang Wu, Chuanguang Yang et al.ICLR 2026 · 17 citations
- QuantSparse: Comprehensively Compressing Video Diffusion Transformer with Model Quantization and Attention SparsificationWeilun Feng, Chuanguang Yang, Haotong Qin, Mingqiang Wu et al.ICLR 2026 · 8 citations
- DeltaQuant: 4-bit Video Diffusion Models with Spatiotemporal Delta SmoothingXingyang Li, Samuel Tesfai, Zhekai Zhang, Haocheng Xi et al.CVPR 2026 · 7 citations
Builds on37
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Directly Denoising Diffusion ModelsDan Zhang, Jingjing Wang, Feng LuoICML 2024 · 11,724 citations
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
Related papers
- ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video GenerationTianchen Zhao, Tongcheng Fang, Haofeng Huang, Rui Wan et al.ICLR 2025
- VQ4DiT: Efficient Post-Training Vector Quantization for Diffusion TransformersJuncan Deng, Shuaiting Li, Zeyu Wang, Hong Gu et al.AAAI 2025 · 12 citations
- Q-DiT: Accurate Post-Training Quantization for Diffusion TransformersLei Chen, Yuan Meng, Chen Tang, Xinzhu Ma et al.CVPR 2025
- VETA-DiT: Variance-Equalized and Temporally Adaptive Quantization for Efficient 4-bit Diffusion TransformersQinkai Xu, Yijin Liu, Yang Chen, Lin F. Yang et al.NeurIPS 2025 · 3 citations
- DVD-Quant: Data-free Video Diffusion Transformers QuantizationZhiteng Li, Hanxuan Li, Junyi Wu, Kai Liu et al.ICLR 2026 · 13 citations
