FACET: A Fragment-Aware Conformer Ensemble Transformer
Duy Nguyen, Trung Nguyen, Hong-Ha Le, Mai T. N. Truong, TrungTin Nguyen, Nhat Ho, Khoa D. Doan, Duy Duong-Tran, Li Shen, Daniel Sonntag, James Y. Zou, Mathias Niepert
Abstract
Accurately predicting molecular properties requires effective integration of structural information from both 2D molecular graphs and their corresponding equilibrium conformer ensembles. In this work, we propose FACET, a scalable Structure-Aware Graph Transformer that efficiently aggregates features from multiple 3D conformers while incorporating fragment-level information from 2D graphs. Unlike prior methods that rely on static geometric solvers or rigid fusion strategies, our approach utilizes a differentiable graph transformer to theoretically approximate the computationally expensive Fused Gromov-Wasserstein (FGW), enabling dynamic and scalable fusion of 2D and 3D structural information. We further enhance this mechanism by injecting fragment-specific structural priors into the attention layers, enabling the model to capture fine-grained molecular details. This unified design scales to large datasets, handling up to 75,000 molecules and hundreds of thousands of conformers, and provides over a 6x speedup compared to geometry-aware FGW-based baselines. Our method also achieves state-of-the-art results in molecular property prediction, Boltzmann-weighted ensemble modeling, and reaction-level tasks, and is particularly effective on chemically diverse compounds, including organocatalysts and transition-metal complexes. We provide implementations at this link: Code implementation
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fd3791f5-ce12-47f5-b27e-d122b5a0ce12Builds on28
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Strategies for Pre-training Graph Neural NetworksWeihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik et al.ICLR 2020 · 1,744 citations
- Do Transformers Really Perform Badly for Graph Representation?Chengxuan Ying, Tianle Cai, Shengjie Luo, Shuxin Zheng et al.NeurIPS 2021 · 1,632 citations
- MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force FieldsIlyes Batatia, Dávid Péter Kovács, Gregor N. C. Simm, Christoph Ortner et al.NeurIPS 2022 · 1,448 citations
- Recipe for a General, Powerful, Scalable Graph TransformerLadislav Rampásek, Michael Galkin, Vijay Prakash Dwivedi, Anh Tuan Luu et al.NeurIPS 2022 · 1,216 citations
Related papers
- Structure-Aware E(3)-Invariant Molecular Conformer Aggregation NetworksDuy Minh Ho Nguyen, Nina Lukashina, Tai Nguyen, An T. Le et al.ICML 2024 · 9 citations
- Learning the Neighborhood: Contrast-Free Multimodal Self-Supervised Molecular Graph PretrainingBoshra Ariguib, Mathias Niepert, Andrei ManolacheICML 2026
- Learning Over Molecular Conformer Ensembles: Datasets and BenchmarksYanqiao Zhu, Jeehyun Hwang, Keir Adams, Zhen Liu et al.ICLR 2024 · 13 citations
- MOL-Mamba: Enhancing Molecular Representation with Structural & Electronic InsightsJingjing Hu, Dan Guo, Zhan Si, Deguang Liu et al.AAAI 2025 · 9 citations
- ET-Flow: Equivariant Flow-Matching for Molecular Conformer GenerationMajdi Hassan, Nikhil Shenoy, Jungyoon Lee, Hannes Stärk et al.NeurIPS 2024 · 50 citations
