Physics-informed Reinforcement Learning for Perception and Reasoning about Fluids

03/11/2022
by   Beatriz Moya, et al.
28

Learning and reasoning about physical phenomena is still a challenge in robotics development, and computational sciences play a capital role in the search for accurate methods able to provide explanations for past events and rigorous forecasts of future situations. We propose a physics-informed reinforcement learning strategy for fluid perception and reasoning from observations. As a model problem, we take the sloshing phenomena of different fluids contained in a glass. Starting from full-field and high-resolution synthetic data for a particular fluid, we develop a method for the tracking (perception) and analysis (reasoning) of any previously unseen liquid whose free surface is observed with a commodity camera. This approach demonstrates the importance of physics and knowledge not only in data-driven (grey box) modeling but also in the correction for real physics adaptation in low data regimes and partial observations of the dynamics. The method here presented is extensible to other domains such as the development of cognitive digital twins, able to learn from observation of phenomena for which they have not been trained explicitly.

READ FULL TEXT

page 5

page 10

page 12

research
12/22/2020

Fast Fluid Simulations in 3D with Physics-Informed Deep Learning

Physically plausible fluid simulations play an important role in modern ...
research
06/24/2021

Physics perception in sloshing scenes with guaranteed thermodynamic consistency

Physics perception very often faces the problem that only limited data o...
research
06/22/2021

Making Invisible Visible: Data-Driven Seismic Inversion with Physics-Informed Data Augmentation

Deep learning and data-driven approaches have shown great potential in s...
research
11/03/2020

Differentiable Physics Models for Real-world Offline Model-based Reinforcement Learning

A limitation of model-based reinforcement learning (MBRL) is the exploit...
research
11/17/2021

Learning Free-Surface Flow with Physics-Informed Neural Networks

The interface between data-driven learning methods and classical simulat...
research
10/25/2021

Physics Informed Machine Learning of SPH: Machine Learning Lagrangian Turbulence

Smoothed particle hydrodynamics (SPH) is a mesh-free Lagrangian method f...
research
09/05/2023

A Survey on Physics Informed Reinforcement Learning: Review and Open Problems

The inclusion of physical information in machine learning frameworks has...

Please sign up or login with your details

Forgot password? Click here to reset