Parallel Jacobi Decoding for Fast Autoregressive Image Generation
Boya Liao, Ying Li, Siyong Jian, Huan Wang
Abstract
Autoregressive (AR) models have demonstrated remarkable performance in generating high-fidelity images.However, their inherently sequential next-token prediction leads to significantly slows inference.Recent studies have introduced Jacobi-style decoding to accelerate autoregressive image generation.Extending the draft sequence initially improves efficiency, yet the acceleration quickly saturates as error propagation in the one-dimensional sequence hinders convergence.Observing that images exhibit strong local spatial correlations, we propose Parallel Jacobi Decoding (PJD), a training-free decoding approach that expands draft tokens in the two-dimensional spatial domain to enable efficient spatially parallel refinement.PJD adjusts the attention mask to mitigate error accumulation and improve convergence stability.Extensive experiments on diverse datasets show that PJD achieves 4.8×–6.4× acceleration across multiple autoregressive image generation models while preserving image quality.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ab02b1cd-e4d4-4d4e-920a-0de08635964eBuilds on31
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Directly Denoising Diffusion ModelsDan Zhang, Jingjing Wang, Feng LuoICML 2024 · 11,724 citations
- Zero-Shot Text-to-Image GenerationAditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray et al.ICML 2021 · 6,356 citations
Related papers
- Accelerating Auto-regressive Text-to-Image Generation with Training-free Speculative Jacobi DecodingYao Teng, Han Shi, Xian Liu, Xuefei Ning et al.ICLR 2025
- Speculative Jacobi-Denoising Decoding for Accelerating Autoregressive Text-to-image GenerationYao Teng, Fuyun Wang, Xian Liu, Zhekai Chen et al.NeurIPS 2025 · 8 citations
- ZipAR: Parallel Autoregressive Image Generation through Spatial LocalityYefei He, Feng Chen, Yuanyu He, Shaoxuan He et al.ICML 2025
- Speculative Coupled Decoding for Training-Free Lossless Acceleration of Autoregressive Visual GenerationJunhyuk So, Hyunho Kook, Chaeyeon Jang, Eunhyeok ParkICML 2026 · 3 citations
- Locality-aware Parallel Decoding for Efficient Autoregressive Image GenerationZhuoyang Zhang, Luke J. Huang, Chengyue Wu, Shang Yang et al.ICLR 2026 · 8 citations
