Learning to Discover Regulatory Elements for Gene Expression Prediction
Xingyu Su, Haiyang Yu, Degui Zhi, Shuiwang Ji
Abstract
We consider the problem of predicting gene expressions from DNA sequences.
A key challenge of this task is to find the regulatory elements that control gene expressions. Here, we introduce Seq2Exp, a Sequence to Expression network explicitly designed to discover and extract regulatory elements that drive target gene expression, enhancing the accuracy of the gene expression prediction. Our approach captures the causal relationship between epigenomic signals, DNA sequences and their associated regulatory elements. Specifically, we propose to decompose the epigenomic signals and the DNA sequence conditioned on the causal active regulatory elements, and apply an information bottleneck with the Beta distribution to combine their effects while filtering out non-causal components. Our experiments demonstrate that Seq2Exp outperforms existing baselines in gene expression prediction tasks and discovers influential regions compared to commonly used statistical methods for peak detection such as MACS3. The source code is released as part of the AIRS library (https://github.com/divelab/AIRS/).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- Iterative Distillation for Reward-Guided Fine-Tuning of Diffusion Models in Biomolecular DesignXingyu Su, Xiner Li, Masatoshi Uehara, Sunwoo Kim et al.ICLR 2026 · 10 citations
- PatchDNA: A Flexible and Biologically-Informed Alternative to Tokenization for DNAAlice Del Vecchio, Chantriolnt-Andreas Kapourani, Abdullah M Athar, Agnieszka Dobrowolska et al.ICLR 2026 · 2 citations
- Extending Sequence Length is Not All You Need: Effective Integration of Multimodal Signals for Gene Expression PredictionZhao Yang, Yi Duan, Jiwei Zhu, Ying Ba et al.ICLR 2026 · 1 citation
Builds on9
- HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide ResolutionEric Nguyen, Michael Poli, Marjan Faizi, Armin W. Thomas et al.NeurIPS 2023 · 574 citations
- Hyena Hierarchy: Towards Larger Convolutional Language ModelsMichael Poli, Stefano Massaroli, Eric Nguyen, Daniel Y. Fu et al.ICML 2023 · 481 citations
- Graph Information BottleneckTailin Wu, Hongyu Ren, Pan Li, Jure LeskovecNeurIPS 2020 · 366 citations
- Discovering Invariant Rationales for Graph Neural NetworksYingxin Wu, Xiang Wang, An Zhang, Xiangnan He et al.ICLR 2022 · 313 citations
- Interpretable and Generalizable Graph Learning via Stochastic Attention MechanismSiqi Miao, Mia Liu, Pan LiICML 2022 · 288 citations
Related papers
- Gene Regulatory Network Inference using 3D Convolutional Neural NetworkYue Fan, Xiuli MaAAAI 2021 · 23 citations
- InfoSEM: A Deep Generative Model with Informative Priors for Gene Regulatory Network InferenceTianyu Cui, Song-Jun Xu, Artem Moskalev, Shuwei Li et al.ICML 2025
- Fourier-transform-based attribution priors improve the interpretability and stability of deep learning models for genomicsAlex Tseng, Avanti Shrikumar, Anshul KundajeNeurIPS 2020 · 38 citations
- Multi-modal Transfer Learning between Biological Foundation ModelsJuan Jose Garau-Luis, Patrick Bordes, Liam Gonzalez, Masa Roller et al.NeurIPS 2024 · 19 citations
- BEND: Benchmarking DNA Language Models on Biologically Meaningful TasksFrederikke Isa Marin, Felix Teufel, Marc Horlacher, Dennis Madsen et al.ICLR 2024 · 75 citations
