Adaptive DNA Sequence Modeling via Synergistic Plasticity Units
Binghao Liu, Wenzheng Zhao, Zhijie Zheng, Fei Gu
摘要
Effective DNA modeling demands the integration of complex patterns such as local motifs, long-range dependencies, and periodic signals. Yet, architectures like CNNs, Transformers, and SSMs are hindered by static or time-domain-exclusive designs, which limit their representational flexibility. To address this, we introduce the Synergistic Plasticity Unit (SPU) , a scalable architecture that achieves multi-level plasticity through three synergistic layers. Specifically, SPU integrates a Locus Plasticity Layer (LPL) to capture fine-grained local motifs via token-specific convolution operations, while utilizing a Domain Plasticity Layer (DPL) to form multi-domain global features by concurrently modeling sequential (time) and spectral (frequency) patterns. Furthermore, it incorporates a Saliency Plasticity Layer (SPL) to optimize information flow through dual-axis saliency scoring. Supported by theoretical analysis, extensive empirical validation, and in-depth biological interpretation, this unified design enables SPU to achieve state-of-the-art performance with quasi-linear complexity, establishing a robust and principled paradigm for DNA modeling.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper8
- A ConvNet for the 2020sZhuang Liu, Hanzi Mao, Chao-Yuan Wu, Christoph Feichtenhofer 等CVPR 2022 · 被引用 6,782 次
- HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide ResolutionEric Nguyen, Michael Poli, Marjan Faizi, Armin W. Thomas 等NeurIPS 2023 · 被引用 574 次
- Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence ModelingYair Schiff, Chia-Hsiang Kao, Aaron Gokaslan, Tri Dao 等ICML 2024 · 被引用 195 次
- BEND: Benchmarking DNA Language Models on Biologically Meaningful TasksFrederikke Isa Marin, Felix Teufel, Marc Horlacher, Dennis Madsen 等ICLR 2024 · 被引用 75 次
- Extending Sequence Length is Not All You Need: Effective Integration of Multimodal Signals for Gene Expression PredictionZhao Yang, Yi Duan, Jiwei Zhu, Ying Ba 等ICLR 2026 · 被引用 1 次
相关 Paper
- Model Decides How to Tokenize: Adaptive DNA Sequence Tokenization with MxDNALifeng Qiao, Peng Ye, Yuchen Ren, Weiqiang Bai 等NeurIPS 2024 · 被引用 23 次
- TrinityDNA: A Bio-Inspired Foundational Model for Efficient Long-Sequence DNA ModelingQirong Yang, Yucheng Guo, Zicheng Liu, Yujie Yang 等AAAI 2026 · 被引用 4 次
- MergeDNA: Context-Aware Genome Modeling with Dynamic Tokenization Through Token MergingSiyuan Li, Kai Yu, Anna Wang, Zicheng Liu 等AAAI 2026 · 被引用 2 次
- PatchDNA: A Flexible and Biologically-Informed Alternative to Tokenization for DNAAlice Del Vecchio, Chantriolnt-Andreas Kapourani, Abdullah M Athar, Agnieszka Dobrowolska 等ICLR 2026 · 被引用 2 次
- Mechanistic Design and Scaling of Hybrid ArchitecturesMichael Poli, Armin W. Thomas, Eric Nguyen, Pragaash Ponnusamy 等ICML 2024 · 被引用 57 次
