Triangle Multiplication is All You Need for Biomolecular Structure Representations
Jeffrey Ouyang-Zhang, Pranav Murugan, Daniel Jesus Diaz, Gianluca Scarpellini, Richard Strong Bowen, Nate Gruver, Adam Klivans, Philipp Kraehenbuehl, Aleksandra Faust, Maruan Al-Shedivat
Abstract
AlphaFold has transformed protein structure prediction, but emerging applications such as virtual ligand screening, proteome-wide folding, and de novo binder design demand predictions at a massive scale, where runtime and memory costs become prohibitive. A major bottleneck lies in the Pairformer backbone of AlphaFold3-style models, which relies on computationally expensive triangular primitives-especially triangle attention-for pairwise reasoning. We introduce Pairmixer, a streamlined alternative that eliminates triangle attention while preserving higher-order geometric reasoning capabilities that are critical for structure prediction. Pairmixer substantially improves computational efficiency, matching state-of-the-art structure predictors across folding and docking benchmarks, delivering up to 4× faster inference on long sequences while reducing training cost by 34%. Its efficiency alleviates the computational burden of downstream applications such as modeling large protein complexes, high-throughput ligand and binder screening, and hallucination-based design. Within BoltzDesign, for example, Pairmixer delivers over 2× faster sampling and scales to sequences ∼30% longer than the memory limits of Pairformer. Code is available at https://github.com/genesistherapeutics/pairmixer .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8aa75d96-13b4-4c58-b596-c5928cf2ca82Builds on6
- MLP-Mixer: An all-MLP Architecture for VisionIlya O. Tolstikhin, Neil Houlsby, Alexander Kolesnikov, Lucas Beyer et al.NeurIPS 2021 · 3,862 citations
- Hyena Hierarchy: Towards Larger Convolutional Language ModelsMichael Poli, Stefano Massaroli, Eric Nguyen, Daniel Y. Fu et al.ICML 2023 · 481 citations
- Representational Strengths and Limitations of TransformersClayton Sanford, Daniel J. Hsu, Matus TelgarskyNeurIPS 2023 · 162 citations
- SimpleFold: Folding Proteins is Simpler than You ThinkYuyang Wang, Jiarui Lu, Navdeep Jaitly, Joshua M. Susskind et al.ICLR 2026 · 29 citations
- Proteina: Scaling Flow-based Protein Structure Generative ModelsTomas Geffner, Kieran Didi, Zuobai Zhang, Danny Reidenbach et al.ICLR 2025
Related papers
- DCFold: Efficient Protein Structure Generation with Single Forward PassZhe Zhang, Yuanning Feng, Yuxuan Song, Keyue Qiu et al.ICLR 2026 · 3 citations
- Towards All-Atom Foundation Models for Biomolecular Binding Affinity PredictionLiang Shi, Zuobai Zhang, Huiyu Cai, Santiago Miret et al.ICLR 2026
- FastFold: Optimizing AlphaFold Training and Inference on GPU ClustersShenggan Cheng, Xuanlei Zhao, Guangyang Lu, Jiarui Fang et al.PPoPP 2024 · 11 citations
- Generating Highly Designable Proteins with Geometric Algebra Flow MatchingSimon Wagner, Leif Seute, Vsevolod Viliuga, Nicolas Wolf et al.NeurIPS 2024 · 9 citations
- NeuralPLexer3: Accurate Biomolecular Complex Structure Prediction with Flow ModelsJarren Zhuoran Qiao, Feizhi Ding, Thomas Dresselhaus, Mia A. Rosenfeld et al.NeurIPS 2025 · 23 citations
