Parallel Jacobi Decoding for Fast Autoregressive Image Generation
Boya Liao, Ying Li, Siyong Jian, Huan Wang
摘要
Autoregressive (AR) models have demonstrated remarkable performance in generating high-fidelity images.However, their inherently sequential next-token prediction leads to significantly slows inference.Recent studies have introduced Jacobi-style decoding to accelerate autoregressive image generation.Extending the draft sequence initially improves efficiency, yet the acceleration quickly saturates as error propagation in the one-dimensional sequence hinders convergence.Observing that images exhibit strong local spatial correlations, we propose Parallel Jacobi Decoding (PJD), a training-free decoding approach that expands draft tokens in the two-dimensional spatial domain to enable efficient spatially parallel refinement.PJD adjusts the attention mask to mitigate error accumulation and improve convergence stability.Extensive experiments on diverse datasets show that PJD achieves 4.8×–6.4× acceleration across multiple autoregressive image generation models while preserving image quality.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper31
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Directly Denoising Diffusion ModelsDan Zhang, Jingjing Wang, Feng LuoICML 2024 · 被引用 11,724 次
- Zero-Shot Text-to-Image GenerationAditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray 等ICML 2021 · 被引用 6,356 次
相关 Paper
- Accelerating Auto-regressive Text-to-Image Generation with Training-free Speculative Jacobi DecodingYao Teng, Han Shi, Xian Liu, Xuefei Ning 等ICLR 2025
- Speculative Jacobi-Denoising Decoding for Accelerating Autoregressive Text-to-image GenerationYao Teng, Fuyun Wang, Xian Liu, Zhekai Chen 等NeurIPS 2025 · 被引用 8 次
- ZipAR: Parallel Autoregressive Image Generation through Spatial LocalityYefei He, Feng Chen, Yuanyu He, Shaoxuan He 等ICML 2025
- Speculative Coupled Decoding for Training-Free Lossless Acceleration of Autoregressive Visual GenerationJunhyuk So, Hyunho Kook, Chaeyeon Jang, Eunhyeok ParkICML 2026 · 被引用 3 次
- Locality-aware Parallel Decoding for Efficient Autoregressive Image GenerationZhuoyang Zhang, Luke J. Huang, Chengyue Wu, Shang Yang 等ICLR 2026 · 被引用 8 次
