MetaNO: How to Transfer Your Knowledge on Learning Hidden Physics.

Journal: Computer methods in applied mechanics and engineering
Published Date:

Abstract

Gradient-based meta-learning methods have primarily been applied to classical machine learning tasks such as image classification. Recently, PDE-solving deep learning methods, such as neural operators, are starting to make an important impact on learning and predicting the response of a complex physical system directly from observational data. Taking the material modeling problems for example, the neural operator approach learns a surrogate mapping from the loading field to the corresponding material response field, which can be seen as learning the solution operator of a hidden PDE. The microstructure and mechanical parameters of each material specimen correspond to the (possibly heterogeneous) parameter field in this hidden PDE. Due to the limitation on experimental measurement techniques, the data acquisition for each material specimen is commonly challenging and costly. This fact calls for the utilization and transfer of existing knowledge to new and unseen material specimens, which corresponds to sampling efficient learning of the solution operator of a hidden PDE with a different parameter field. Herein, we propose a novel meta-learning approach for neural operators, which can be seen as transferring the knowledge of solution operators between governing (unknown) PDEs with varying parameter fields. Our approach is a provably universal solution operator for multiple PDE solving tasks, with a key theoretical observation that underlying parameter fields can be captured in the first layer of neural operator models, in contrast to typical final-layer transfer in existing meta-learning methods. As applications, we demonstrate the efficacy of our proposed approach on PDE-based datasets and a real-world material modeling problem, illustrating that our method can handle complex and nonlinear physical response learning tasks while greatly improving the sampling efficiency in unseen tasks.

Authors

  • Lu Zhang
    Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX, United States.
  • Huaiqian You
    Department of Mathematics, Lehigh University, Bethlehem, PA, USA.
  • Tian Gao
    IBM Research, Yorktown Heights, NY, USA.
  • Mo Yu
    Pattern Recognition Center, WeChat AI, Tencent Inc, China.
  • Chung-Hao Lee
    School of Aerospace and Mechanical Engineering, The University of Oklahoma, Norman, OK, USA.
  • Yue Yu
    Department of Mathematics, Lehigh University, Bethlehem, PA, USA.

Keywords

No keywords available for this article.