DeepAI AI Chat
Log In Sign Up

Differentiable modeling to unify machine learning and physical models and advance Geosciences

01/10/2023
by   Chaopeng Shen, et al.
0

Process-Based Modeling (PBM) and Machine Learning (ML) are often perceived as distinct paradigms in the geosciences. Here we present differentiable geoscientific modeling as a powerful pathway toward dissolving the perceived barrier between them and ushering in a paradigm shift. For decades, PBM offered benefits in interpretability and physical consistency but struggled to efficiently leverage large datasets. ML methods, especially deep networks, presented strong predictive skills yet lacked the ability to answer specific scientific questions. While various methods have been proposed for ML-physics integration, an important underlying theme – differentiable modeling – is not sufficiently recognized. Here we outline the concepts, applicability, and significance of differentiable geoscientific modeling (DG). "Differentiable" refers to accurately and efficiently calculating gradients with respect to model variables, critically enabling the learning of high-dimensional unknown relationships. DG refers to a range of methods connecting varying amounts of prior knowledge to neural networks and training them together, capturing a different scope than physics-guided machine learning and emphasizing first principles. Preliminary evidence suggests DG offers better interpretability and causality than ML, improved generalizability and extrapolation capability, and strong potential for knowledge discovery, while approaching the performance of purely data-driven ML. DG models require less training data while scaling favorably in performance and efficiency with increasing amounts of data. With DG, geoscientists may be better able to frame and investigate questions, test hypotheses, and discover unrecognized linkages.

READ FULL TEXT

page 7

page 9

page 13

page 38

page 39

09/07/2022

Physics-Guided Adversarial Machine Learning for Aircraft Systems Simulation

In the context of aircraft system performance assessment, deep learning ...
02/07/2023

A conceptual model for leaving the data-centric approach in machine learning

For a long time, machine learning (ML) has been seen as the abstract pro...
03/30/2021

Theory-Guided Machine Learning for Process Simulation of Advanced Composites

Science-based simulation tools such as Finite Element (FE) models are ro...
09/23/2022

Differentiable physics-enabled closure modeling for Burgers' turbulence

Data-driven turbulence modeling is experiencing a surge in interest foll...
07/26/2022

Physics Embedded Machine Learning for Electromagnetic Data Imaging

Electromagnetic (EM) imaging is widely applied in sensing for security, ...
08/29/2022

Differentiable Programming for Earth System Modeling

Earth System Models (ESMs) are the primary tools for investigating futur...