Infusing Self-Consistency into Density Functional Theory Hamiltonian Prediction via Deep Equilibrium Models
Zun Wang, Chang Liu, Nianlong Zou, He Zhang, Xinran Wei, Lin Huang, Lijun Wu, Bin Shao
Abstract
In this study, we introduce a unified neural network architecture, the Deep Equilibrium Density Functional Theory Hamiltonian (DEQH) model, which incorporates Deep Equilibrium Models (DEQs) for predicting Density Functional Theory (DFT) Hamiltonians. The DEQH model inherently captures the self-consistency nature of Hamiltonian, a critical aspect often overlooked by traditional machine learning approaches for Hamiltonian prediction. By employing DEQ within our model architecture, we circumvent the need for DFT calculations during the training phase to introduce the Hamiltonian's self-consistency, thus addressing computational bottlenecks associated with large or complex systems. We propose a versatile framework that combines DEQ with off-the-shelf machine learning models for predicting Hamiltonians. When benchmarked on the MD17 and QH9 datasets, DEQHNet, an instantiation of the DEQH framework, has demonstrated a significant improvement in prediction accuracy. Beyond a predictor, the DEQH model is a Hamiltonian solver, in the sense that it uses the fixed-point solving capability of the deep equilibrium model to iteratively solve for the Hamiltonian. Ablation studies of DEQHNet further elucidate the network's effectiveness, offering insights into the potential of DEQ-integrated networks for Hamiltonian learning. We open source our implementation at https://github.com/Zun-Wang/DEQHNet.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- High-order Equivariant Flow Matching for Density Functional Theory Hamiltonian PredictionSeongsu Kim, Nayoung Kim, Dongwoo Kim, Sungsoo AhnNeurIPS 2025 · 12 citations
- A Function-Centric Graph Neural Network Approach for Predicting Electron DensitiesManuel Viktor Klockow, Marc K. Ickler, Peter Lippmann, Fred A. HamprechtICLR 2026
- Efficient and Scalable Density Functional Theory Hamiltonian Prediction through Adaptive SparsityErpai Luo, Xinran Wei, Lin Huang, Yunyang Li et al.ICML 2025
Builds on15
- MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force FieldsIlyes Batatia, Dávid Péter Kovács, Gregor N. C. Simm, Christoph Ortner et al.NeurIPS 2022 · 1,448 citations
- Directional Message Passing for Molecular GraphsJohannes Klicpera, Janek Groß, Stephan GünnemannICLR 2020 · 1,079 citations
- SE(3)-Transformers: 3D Roto-Translation Equivariant Attention NetworksFabian Fuchs, Daniel E. Worrall, Volker Fischer, Max WellingNeurIPS 2020 · 1,025 citations
- Equivariant message passing for the prediction of tensorial properties and molecular spectraKristof Schütt, Oliver T. Unke, Michael GasteggerICML 2021 · 736 citations
- GemNet: Universal Directional Graph Neural Networks for MoleculesJohannes Gasteiger, Florian Becker, Stephan GünnemannNeurIPS 2021 · 665 citations
Related papers
- Self-Consistency Training for Density-Functional-Theory Hamiltonian PredictionHe Zhang, Chang Liu, Zun Wang, Xinran Wei et al.ICML 2024 · 13 citations
- Enhancing the Scalability and Applicability of Kohn-Sham Hamiltonians for Molecular SystemsYunyang Li, Zaishuo Xia, Lin Huang, Xinran Wei et al.ICLR 2025
- Towards a Transferable Acceleration Method for Density Functional TheoryZhe Liu, Yuyan Ni, Zhichen Pu, Qiming Sun et al.ICLR 2026 · 3 citations
- Efficient and Equivariant Graph Networks for Predicting Quantum HamiltonianHaiyang Yu, Zhao Xu, Xiaofeng Qian, Xiaoning Qian et al.ICML 2023 · 51 citations
- Advancing Universal Deep Learning for Electronic-Structure Hamiltonian Prediction of MaterialsShi Yin, Zujian Dai, Xinyang Pan, Lixin HeICLR 2026 · 7 citations
