ACL Findings2026
Sparse Growing Transformer: Training-Time Sparse Depth Allocation via Progressive Attention Looping
Yao Chen, Yilong Chen, Yinqi Yang, Junyuan Shang, Zhenyu Zhang, Zefeng Zhang, Shuaiyi Nie, Shuohuan Wang, Yu Sun, Hua Wu, Haifeng Wang, Tingwen Liu
Abstract
Yao Chen, Yilong Chen, Yinqi Yang, Junyuan Shang, Zhenyu Zhang, Zefeng Zhang, Shuaiyi Nie, Shuohuan Wang, Yu Sun, Hua Wu, Haifeng Wang, Tingwen Liu. Findings of the Association for Computational Linguistics: ACL 2026. 2026.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 1 top-tier paper that cites it · related work
Free to start. No credit card required.
Cited by top-tier papers1
Builds on35
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Measuring Massive Multitask Language UnderstandingDan Hendrycks, Collin Burns, Steven Basart, Andy Zou et al.ICLR 2021 · 7,905 citations
- Let's Verify Step by StepHunter Lightman, Vineet Kosaraju, Yuri Burda, Harrison Edwards et al.ICLR 2024 · 3,045 citations
- YaRN: Efficient Context Window Extension of Large Language ModelsBowen Peng, Jeffrey Quesnelle, Honglu Fan, Enrico ShippoleICLR 2024 · 508 citations
- Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth ApproachJonas Geiping, Sean McLeish, Neel Jain, John Kirchenbauer et al.NeurIPS 2025 · 431 citations
Related papers
- D²-RAG: Dual-Decision Retrieval-Augmented Generation via Multi-Dimensional Uncertainty and Utility-Aware DecodingJinshuo Zhang, Xiaoding Zhou, Weiyu Zhang, Guoqiang Chen et al.ACL Findings 2026
- AHA: Aligning Large Audio-Language Models for Reasoning Hallucinations via Counterfactual Hard NegativesYanxi Chen, Wenhui Zhu, Xiwen Chen, Zhipeng Wang et al.ACL Findings 2026
- MorphoBench: A Benchmark with Difficulty Adaptive to Model ReasoningXukai Wang, Xuanbo Liu, Mingrui Chen, Haitian Zhong et al.ACL Findings 2026
- Comprehensive Benchmarking of Long-Form Speech Generation in Diverse ScenariosChanghao Pan, Rui Yang, Han Wang, Zhuan Zhou et al.ACL Findings 2026
- Do Vision-Language Models Have Internal World Models? Towards an Atomic EvaluationQiyue Gao, Xinyu Pi, Kevin Liu, Junrong Chen et al.ACL Findings 2025 · 3 citations
