Physics-Informed Pre-training on Efficient Electron-Density Images for Organic Material Property Prediction
Zhixiang Cheng, Hongxin Xiang, Mingquan Liu, Tengfei Ma, Yingzhuo Tu, Wenjie Du, Bosheng Song, Yiping Liu, xiangxiang Zeng
Abstract
Precise property prediction of organic materials is pivotal for next-generation electronic and energy devices. In density functional theory (DFT), the electron density (ED) serves as the fundamental determinant of material properties. Yet, establishing it as an input modality for material property prediction has been impeded by two practical barriers: scarce large-scale ED data and the enormous computational complexity of ED representation. To bridge these gaps, we introduce VisionED, an efficient physics-informed model pre-trained on electron-density images. We curate a dataset of 2 million molecules and represent ED as multi-shot images that efficiently encode both geometric and electronic structure. VisionED is then pre-trained on 12 million multi-shot ED images via cross-scale, physics-informed pretext tasks. Empirical evaluations on photovoltaic and organic chromophore datasets show that VisionED outperforms state-of-the-art baselines by up to 27.0%, exhibiting superior robustness under distribution shifts and data scarcity. Notably, the model generalizes to unseen device-scale applications, successfully recovering experimental trends and mixing-ratio effects in ternary blends with an average accuracy of 92.77%. Moreover, relative to the previous ED point cloud, the ED image improves performance by 26.2% with 2.6 fewer memory and 4.6 lower time. The code and data are available at https://github.com/ZhixiangCheng/VisionED.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3d902757-9cda-446d-bad3-4740c0c0e41aBuilds on6
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree RepresentationsYi-Lun Liao, Brandon M. Wood, Abhishek Das, Tess E. SmidtICLR 2024 · 311 citations
- Geometric Transformer with Interatomic Positional EncodingYusong Wang, Shaoning Li, Tong Wang, Bin Shao et al.NeurIPS 2023 · 25 citations
- X-3D: Explicit 3D Structure Modeling for Point Cloud RecognitionShuofeng Sun, Yongming Rao, Jiwen Lu, Haibin YanCVPR 2024 · 18 citations
- Gaussian Plane-Wave Neural Operator for Electron Density EstimationSeongsu Kim, Sungsoo AhnICML 2024 · 9 citations
Related papers
- ECD: A Machine Learning Benchmark for Predicting Enhanced-Precision Electronic Charge Density in Crystalline Inorganic MaterialsPin Chen, Zexin Xu, Qing Mo, Hongjin Zhong et al.ICLR 2025
- Self-Supervised Diffusion Models for Electron-Aware Molecular Representation LearningGyoung S. Na, Chanyoung ParkICLR 2025
- Self-Consistency Training for Density-Functional-Theory Hamiltonian PredictionHe Zhang, Chang Liu, Zun Wang, Xinran Wei et al.ICML 2024 · 13 citations
- KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property PredictionHan Li, Dan Zhao, Jianyang ZengKDD 2022 · 55 citations
- Electron-Informed Coarse-Graining Molecular Representation Learning for Real-World Molecular PhysicsGyoung S. Na, Chanyoung ParkKDD 2025
