Protein-Nucleic Acid Complex Modeling with Frame Averaging Transformer
Tinglin Huang, Zhenqiao Song, Rex Ying, Wengong Jin
Abstract
Nucleic acid-based drugs like aptamers have recently demonstrated great therapeutic potential. However, experimental platforms for aptamer screening are costly, and the scarcity of labeled data presents a challenge for supervised methods to learn protein-aptamer binding. To this end, we develop an unsupervised learning approach based on the predicted pairwise contact map between a protein and a nucleic acid and demonstrate its effectiveness in protein-aptamer binding prediction. Our model is based on FAFormer, a novel equivariant transformer architecture that seamlessly integrates frame averaging (FA) within each transformer block. This integration allows our model to infuse geometric information into node features while preserving the spatial semantics of coordinates, leading to greater expressive power than standard FA models. Our results show that FAFormer outperforms existing equivariant models in contact map prediction across three protein complex datasets, with over 10% relative improvement. Moreover, we curate five real-world protein-aptamer interaction datasets and show that the contact map predicted by FAFormer serves as a strong binding indicator for aptamer screening.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 496d72c3-e377-4e01-a6b6-f043edc09864Cited by top-tier papers2
- Scalable Generation of Spatial Transcriptomics from Histology Images via Whole-Slide Flow MatchingTinglin Huang, Tianyu Liu, Mehrtash Babadi, Wengong Jin et al.ICML 2025
- All-atom inverse protein folding through discrete flow matchingKai Yi, Kiarash Jamali, Sjors H. W. ScheresICML 2025
Builds on16
- How Attentive are Graph Attention Networks?Shaked Brody, Uri Alon, Eran YahavICLR 2022 · 1,717 citations
- E(n) Equivariant Graph Neural NetworksVictor Garcia Satorras, Emiel Hoogeboom, Max WellingICML 2021 · 1,432 citations
- SE(3)-Transformers: 3D Roto-Translation Equivariant Attention NetworksFabian Fuchs, Daniel E. Worrall, Volker Fischer, Max WellingNeurIPS 2020 · 1,025 citations
- GemNet: Universal Directional Graph Neural Networks for MoleculesJohannes Gasteiger, Florian Becker, Stephan GünnemannNeurIPS 2021 · 665 citations
- Learning from Protein Structure with Geometric Vector PerceptronsBowen Jing, Stephan Eismann, Patricia Suriana, Raphael John Lamarre Townshend et al.ICLR 2021 · 627 citations
Related papers
- Geometric Transformer with Interatomic Positional EncodingYusong Wang, Shaoning Li, Tong Wang, Bin Shao et al.NeurIPS 2023 · 25 citations
- Generalist Equivariant Transformer Towards 3D Molecular Interaction LearningXiangzhe Kong, Wenbing Huang, Yang LiuICML 2024 · 29 citations
- GeoMFormer: A General Architecture for Geometric Molecular Representation LearningTianlang Chen, Shengjie Luo, Di He, Shuxin Zheng et al.ICML 2024 · 9 citations
- ET-Flow: Equivariant Flow-Matching for Molecular Conformer GenerationMajdi Hassan, Nikhil Shenoy, Jungyoon Lee, Hannes Stärk et al.NeurIPS 2024 · 50 citations
- Size-Generalizable RNA Structure Evaluation by Exploring Hierarchical GeometriesZongzhao Li, Jiacheng Cen, Wenbing Huang, Taifeng Wang et al.ICLR 2025
