Chunk, Align, Select: A Simple Long-sequence Processing Method for Transformers
Jiawen Xie, Pengyu Cheng, Xiao Liang, Yong Dai, Nan Du
2024年份
3顶会引用
摘要
Although dominant in natural language processing, transformer-based models remain challenged by the task of long-sequence processing,
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper3
- Self-playing Adversarial Language Game Enhances LLM ReasoningPengyu Cheng, Tianhao Hu, Han Xu, Zhisong Zhang 等NeurIPS 2024 · 被引用 120 次
- DocHieNet: A Large and Diverse Dataset for Document Hierarchy ParsingHangdi Xing, Changxu Cheng, Feiyu Gao, Zirui Shao 等EMNLP 2024 · 被引用 3 次
- Overcoming Vocabulary Mismatch: Vocabulary-agnostic Teacher Guided Language ModelingHaebin Shin, Lei Ji, Xiao Liu, Yeyun GongICML 2025
它引用的顶会 Paper9
- Big Bird: Transformers for Longer SequencesManzil Zaheer, Guru Guruganesh, Kumar Avinava Dubey, Joshua Ainslie 等NeurIPS 2020 · 被引用 3,159 次
- BARTScore: Evaluating Generated Text as Text GenerationWeizhe Yuan, Graham Neubig, Pengfei LiuNeurIPS 2021 · 被引用 1,143 次
- Memorizing TransformersYuhuai Wu, Markus Norman Rabe, DeLesley Hutchins, Christian SzegedyICLR 2022 · 被引用 231 次
- PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document SummarizationWen Xiao, Iz Beltagy, Giuseppe Carenini, Arman CohanACL 2022 · 被引用 147 次
- Rethinking Attention with PerformersKrzysztof Marcin Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song 等ICLR 2021 · 被引用 122 次
相关 Paper
- Hierarchical Walking Transformer for Object Re-IdentificationXudong Tian, Jun Liu, Zhizhong Zhang, Chengjie Wang 等ACM MM 2022 · 被引用 6 次
- The Unstoppable Rise of Computational Linguistics in Deep LearningJames HendersonACL 2020 · 被引用 4 次
- Task Descriptors Help Transformers Learn Linear Models In-ContextRuomin Huang, Rong GeICLR 2025
- Dream Video: Composing Your Dream Videos with Customized Subject and MotionYujie Wei, Shiwei Zhang, Zhiwu Qing, Hangjie Yuan 等CVPR 2024
- AnchorAttention: Difference-Aware Sparse Attention with Stripe GranularityYu Zhang, Dong Guo, Fang Wu, Guoliang Zhu 等EMNLP 2025
