Identification of state functions by physically-guided neural networks with physically-meaningful internal layers

by   Jacobo Ayensa-Jiménez, et al.

Substitution of well-grounded theoretical models by data-driven predictions is not as simple in engineering and sciences as it is in social and economic fields. Scientific problems suffer most times from paucity of data, while they may involve a large number of variables and parameters that interact in complex and non-stationary ways, obeying certain physical laws. Moreover, a physically-based model is not only useful for making predictions, but to gain knowledge by the interpretation of its structure, parameters, and mathematical properties. The solution to these shortcomings seems to be the seamless blending of the tremendous predictive power of the data-driven approach with the scientific consistency and interpretability of physically-based models. We use here the concept of physically-constrained neural networks (PCNN) to predict the input-output relation in a physical system, while, at the same time fulfilling the physical constraints. With this goal, the internal hidden state variables of the system are associated with a set of internal neuron layers, whose values are constrained by known physical relations, as well as any additional knowledge on the system. Furthermore, when having enough data, it is possible to infer knowledge about the internal structure of the system and, if parameterized, to predict the state parameters for a particular input-output relation. We show that this approach, besides getting physically-based predictions, accelerates the training process, reduces the amount of data required to get similar accuracy, filters partly the intrinsic noise in the experimental data and provides improved extrapolation capacity.



There are no comments yet.


page 24

page 34


On the application of Physically-Guided Neural Networks with Internal Variables to Continuum Problems

Predictive Physics has been historically based upon the development of m...

Learning physically consistent mathematical models from data using group sparsity

We propose a statistical learning framework based on group-sparse regres...

Living in the Physics and Machine Learning Interplay for Earth Observation

Most problems in Earth sciences aim to do inferences about the system, w...

Enhancing predictive skills in physically-consistent way: Physics Informed Machine Learning for Hydrological Processes

Current modeling approaches for hydrological modeling often rely on eith...

From granular avalanches to fluid turbulences through oozing pastes. A mesoscopic physically-based particle model

In this paper, we describe how we can precisely produce complex and vari...

Theory-guided hard constraint projection (HCP): a knowledge-based data-driven scientific machine learning method

Machine learning models have been successfully used in many scientific a...

Physical invariance in neural networks for subgrid-scale scalar flux modeling

In this paper we present a new strategy to model the subgrid-scale scala...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.