CRISP: Curriculum based Sequential neural decoders for Polar code family
S. Ashwin Hebbar, Viraj Vivek Nadkarni, Ashok Vardhan Makkuva, Suma Bhat, Sewoong Oh, Pramod Viswanath
Abstract
Polar codes are widely used state-of-the-art codes for reliable communication that have recently been included in the 5th generation wireless standards (5G). However, there remains room for the design of polar decoders that are both efficient and reliable in the short blocklength regime. Motivated by recent successes of data-driven channel decoders, we introduce a novel urculum based equential neural decoder for olar codes (CRISP). We design a principled curriculum, guided by information-theoretic insights, to train CRISP and show that it outperforms the successive-cancellation (SC) decoder and attains near-optimal reliability performance on the Polar(32,16) and Polar(64,22) codes. The choice of the proposed curriculum is critical in achieving the accuracy gains of CRISP, as we show by comparing against other curricula. More notably, CRISP can be readily extended to Polarization-Adjusted-Convolutional (PAC) codes, where existing SC decoders are significantly less reliable. To the best of our knowledge, CRISP constructs the first data-driven decoder for PAC codes and attains near-optimal performance on the PAC(32,16) code.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on8
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Dynamic Curriculum Learning for Imbalanced Data ClassificationYiru Wang, Weihao Gan, Jie Yang, Wei Wu et al.ICCV 2019 · 263 citations
- When Do Curricula Work?Xiaoxia Wu, Ethan Dyer, Behnam NeyshaburICLR 2021 · 141 citations
- Error Correction Code TransformerYoni Choukroun, Lior WolfNeurIPS 2022 · 121 citations
- Structured Pruning of Large Language ModelsZiheng Wang, Jeremy Wohlwend, Tao LeiEMNLP 2020 · 88 citations
Related papers
- DeepPolar: Inventing Nonlinear Large-Kernel Polar Codes via Deep LearningS. Ashwin Hebbar, Sravan Kumar Ankireddy, Hyeji Kim, Sewoong Oh et al.ICML 2024 · 14 citations
- Learning to Decode: Reinforcement Learning for Decoding of Sparse Graph-Based Channel CodesSalman Habib, Allison Beemer, Jörg KliewerNeurIPS 2020 · 15 citations
- KO codes: inventing nonlinear encoding and decoding for reliable wireless communication via deep-learningAshok Vardhan Makkuva, Xiyang Liu, Mohammad Vahid Jamali, Hessam Mahdavifar et al.ICML 2021 · 52 citations
- Learning Linear Block Error Correction CodesYoni Choukroun, Lior WolfICML 2024 · 18 citations
- Cyclically Equivariant Neural Decoders for Cyclic CodesXiangyu Chen, Min YeICML 2021 · 27 citations
