Deep language models for interpretative and predictive materials science
Name
010901_1_5.0134317.pdf
Description
Published version
Size
12.46 MB
Format
Adobe PDF
Checksum (MD5)
ecd90b3857cd934054648eb93d12e197
Author(s)
Hu, Yiwen
Buehler, Markus J
Date Issued
February 14, 2023
Journal
APL Machine Learning
Publisher
AIP Publishing
Citation
Yiwen Hu, Markus J. Buehler; Deep language models for interpretative and predictive materials science. APL Mach. Learn. 1 March 2023; 1 (1): 010901.
Version
Final published version
Abstract
Machine learning (ML) has emerged as an indispensable methodology to describe, discover, and predict complex physical phenomena that efficiently help us learn underlying functional rules, especially in cases when conventional modeling approaches cannot be applied. While conventional feedforward neural networks are typically limited to performing tasks related to static patterns in data, recursive models can both work iteratively based on a changing input and discover complex dynamical relationships in the data. Deep language models can model flexible modalities of data and are capable of learning rich dynamical behaviors as they operate on discrete or continuous symbols that define the states of a physical system, yielding great potential toward end-to-end predictions. Similar to how words form a sentence, materials can be considered as a self-assembly of physically interacted building blocks, where the emerging functions of materials are analogous to the meaning of sentences. While discovering the fundamental relationships between building blocks and function emergence can be challenging, language models, such as recurrent neural networks and long-short term memory networks, and, in particular, attention models, such as the transformer architecture, can solve many such complex problems. Application areas of such models include protein folding, molecular property prediction, prediction of material failure of complex nonlinear architected materials, and also generative strategies for materials discovery. We outline challenges and opportunities, especially focusing on extending the deep-rooted kinship of humans with symbolism toward generalizable artificial intelligence (AI) systems using neuro-symbolic AI, and outline how tools such as ChatGPT and DALL·E can drive materials discovery.
MIT Department
Massachusetts Institute of Technology. Laboratory for Atomistic and Molecular Mechanics
Massachusetts Institute of Technology. Center for Computational Science and Engineering
Terms of Use
Creative Commons Attribution
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1063/5.0134317
