Adaptive DNA Sequence Modeling via Synergistic Plasticity Units
Binghao Liu, Wenzheng Zhao, Zhijie Zheng, Fei Gu
Abstract
Effective DNA modeling demands the integration of complex patterns such as local motifs, long-range dependencies, and periodic signals. Yet, architectures like CNNs, Transformers, and SSMs are hindered by static or time-domain-exclusive designs, which limit their representational flexibility. To address this, we introduce the Synergistic Plasticity Unit (SPU) , a scalable architecture that achieves multi-level plasticity through three synergistic layers. Specifically, SPU integrates a Locus Plasticity Layer (LPL) to capture fine-grained local motifs via token-specific convolution operations, while utilizing a Domain Plasticity Layer (DPL) to form multi-domain global features by concurrently modeling sequential (time) and spectral (frequency) patterns. Furthermore, it incorporates a Saliency Plasticity Layer (SPL) to optimize information flow through dual-axis saliency scoring. Supported by theoretical analysis, extensive empirical validation, and in-depth biological interpretation, this unified design enables SPU to achieve state-of-the-art performance with quasi-linear complexity, establishing a robust and principled paradigm for DNA modeling.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 315a4088-4983-4b84-ae3f-73b87f29a6dfBuilds on8
- A ConvNet for the 2020sZhuang Liu, Hanzi Mao, Chao-Yuan Wu, Christoph Feichtenhofer et al.CVPR 2022 · 6,782 citations
- HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide ResolutionEric Nguyen, Michael Poli, Marjan Faizi, Armin W. Thomas et al.NeurIPS 2023 · 574 citations
- Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence ModelingYair Schiff, Chia-Hsiang Kao, Aaron Gokaslan, Tri Dao et al.ICML 2024 · 195 citations
- BEND: Benchmarking DNA Language Models on Biologically Meaningful TasksFrederikke Isa Marin, Felix Teufel, Marc Horlacher, Dennis Madsen et al.ICLR 2024 · 75 citations
- Extending Sequence Length is Not All You Need: Effective Integration of Multimodal Signals for Gene Expression PredictionZhao Yang, Yi Duan, Jiwei Zhu, Ying Ba et al.ICLR 2026 · 1 citation
Related papers
- Model Decides How to Tokenize: Adaptive DNA Sequence Tokenization with MxDNALifeng Qiao, Peng Ye, Yuchen Ren, Weiqiang Bai et al.NeurIPS 2024 · 23 citations
- TrinityDNA: A Bio-Inspired Foundational Model for Efficient Long-Sequence DNA ModelingQirong Yang, Yucheng Guo, Zicheng Liu, Yujie Yang et al.AAAI 2026 · 4 citations
- MergeDNA: Context-Aware Genome Modeling with Dynamic Tokenization Through Token MergingSiyuan Li, Kai Yu, Anna Wang, Zicheng Liu et al.AAAI 2026 · 2 citations
- PatchDNA: A Flexible and Biologically-Informed Alternative to Tokenization for DNAAlice Del Vecchio, Chantriolnt-Andreas Kapourani, Abdullah M Athar, Agnieszka Dobrowolska et al.ICLR 2026 · 2 citations
- Mechanistic Design and Scaling of Hybrid ArchitecturesMichael Poli, Armin W. Thomas, Eric Nguyen, Pragaash Ponnusamy et al.ICML 2024 · 57 citations
