DPA-2: a large atomic model as a multi-task learner
Duo Zhang, Xinzijian Liu, Xiangyu Zhang et al. · npj Computational Materials · 2024
The rapid advancements in artificial intelligence (AI) are catalyzing transformative changes in atomic modeling, simulation, and design. AI-driven potential energy models have demonstrated the capability to conduct large-scale, long-duration simulations with the accuracy of ab initio electronic structure methods. However, the model generation process remains a bottleneck for large-scale applications. We propose a shift towards a model-centric ecosystem, wherein a large atomic model (LAM), pre-trained across multiple disciplines, can be efficiently fine-tuned and distilled for various downstream tasks, thereby establishing a new framework for molecular modeling. In this study, we introduce the DPA-2 architecture as a prototype for LAMs. Pre-trained on a diverse array of chemical and materials systems using a multi-task approach, DPA-2 demonstrates superior generalization capabilities across multiple downstream tasks compared to the traditional single-task pre-training and fine-tuning methodologies. Our approach sets the stage for the development and broad application of LAMs in molecular and materials simulation research.
Cited by 152 works. doi:10.1038/s41524-024-01493-2 Open-access PDF
Authors
- Duo Zhang
- Xinzijian Liu
- Xiangyu Zhang
- Chengqian Zhang
- Chun Cai
- Hangrui Bi
- Yiming Du
- Xuejian Qin
- Anyang Peng
- Jiameng Huang
- Bowen Li
- Yifan Shan
- Jinzhe Zeng
- Yuzhi Zhang
- Siyuan Liu
- Yifan Li
- Junhan Chang
- Xinyan Wang
- Shuo Zhou
- Jianchuan Liu
References
- Generalized Gradient Approximation Made Simple
- Self-Consistent Equations Including Exchange and Correlation Effects
- Inhomogeneous Electron Gas
- Efficient iterative schemes for ab initio total-energy calculations using a plane-wave basis set
- AutoResearch Lite: a reproducible paper-inspired experiment runner (Adam mechanism reproduction and convergence-speed comparison)
- Efficiency of ab-initio total energy calculations for metals and semiconductors using a plane-wave basis set
- AI-Assisted Pipeline for Dynamic Generation of Trustworthy Health Supplement Content at Scale
- Unified Approach for Molecular Dynamics and Density-Functional Theory
- Representation Learning: A Review and New Perspectives
- Commentary: The Materials Project: A materials genome approach to accelerating materials innovation