Coordinate Denoising for Non‑Equilibrium Molecular Representation Learning
Qianwei Tang, Baile Xu, Jian Zhao, Furao Shen
Abstract
Three-dimensional molecular representation learning has shown great promise in modeling chemical structures and their properties. However, most existing approaches implicitly assume molecules are at or near equilibrium states. This assumption breaks down for non-equilibrium structures—ubiquitous in molecular dynamics (MD) trajectories—where standard coordinate denoising techniques fail because the direct equivalence between denoising scores and atomic forces no longer holds. To bridge this gap, we propose Node Denoising on non-Equilibrium Molecules (NDeM), a novel auxiliary task grounded in a second-order finite difference approximation of the potential energy surface. By explicitly accounting for the non-zero inherent forces in non-equilibrium states, NDeM provides a theoretically sound denoising objective applicable to arbitrary molecular conformations. Crucially, our method is designed as a lightweight, architecture-agnostic plugin that requires no pre-training and can be seamlessly integrated into various supervised learning pipelines. Extensive experiments across diverse benchmarks, including MD17, QM9, and the large-scale OC20 dataset, demonstrate that NDeM consistently improves baseline models, yielding highly competitive performance and validating its robustness across both equilibrium and non-equilibrium regimes.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on21
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- E(n) Equivariant Graph Neural NetworksVictor Garcia Satorras, Emiel Hoogeboom, Max WellingICML 2021 · 1,432 citations
- Directional Message Passing for Molecular GraphsJohannes Klicpera, Janek Groß, Stephan GünnemannICLR 2020 · 1,079 citations
- SE(3)-Transformers: 3D Roto-Translation Equivariant Attention NetworksFabian Fuchs, Daniel E. Worrall, Volker Fischer, Max WellingNeurIPS 2020 · 1,025 citations
- Equivariant message passing for the prediction of tensorial properties and molecular spectraKristof Schütt, Oliver T. Unke, Michael GasteggerICML 2021 · 736 citations
Related papers
- Pre-training via Denoising for Molecular Property PredictionSheheryar Zaidi, Michael Schaarschmidt, James Martens, Hyunjik Kim et al.ICLR 2023 · 30 citations
- Learning 3D Anisotropic Noise Distributions Improves Molecular Force FieldsXixian Liu, Rui Jiao, Zhiyuan Liu, Yurou Liu et al.NeurIPS 2025 · 3 citations
- May the Force be with You: Unified Force-Centric Pre-Training for 3D Molecular ConformationsRui Feng, Qi Zhu, Huan Tran, Binghong Chen et al.NeurIPS 2023 · 16 citations
- Energy-Motivated Equivariant Pretraining for 3D Molecular GraphsRui Jiao, Jiaqi Han, Wenbing Huang, Yu Rong et al.AAAI 2023 · 64 citations
- Molecular Geometry Pretraining with SE(3)-Invariant Denoising Distance MatchingShengchao Liu, Hongyu Guo, Jian TangICLR 2023 · 17 citations
