DeepAI AI Chat
Log In Sign Up

Physics-based Neural Networks for Shape from Polarization

03/25/2019
by   Yunhao Ba, et al.
10

How should prior knowledge from physics inform a neural network solution? We study the blending of physics and deep learning in the context of Shape from Polarization (SfP). The classic SfP problem recovers an object's shape from polarized photographs of the scene. The SfP problem is special because the physical models are only approximate. Previous attempts to solve SfP have been purely model-based, and are susceptible to errors when real-world conditions deviate from the idealized physics. In our solution, there is a subtlety to combining physics and neural networks. Our final solution blends deep learning with synthetic renderings (derived from physics) in the framework of a two-stage encoder. The lessons learned from this exemplary problem foreshadow the future impact of physics-based learning.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 6

page 7

page 8

page 9

05/27/2020

How to do Physics-based Learning

The goal of this tutorial is to explain step-by-step how to implement ph...
09/27/2022

Phy-Taylor: Physics-Model-Based Deep Neural Networks

Purely data-driven deep neural networks (DNNs) applied to physical engin...
11/05/2019

Interpretability Study on Deep Learning for Jet Physics at the Large Hadron Collider

Using deep neural networks for identifying physics objects at the Large ...
04/03/2019

Including Physics in Deep Learning -- An example from 4D seismic pressure saturation inversion

Geoscience data often have to rely on strong priors in the face of uncer...
09/17/2020

Kohn-Sham equations as regularizer: building prior knowledge into machine-learned physics

Including prior knowledge is important for effective machine learning mo...
06/08/2010

Computing by Means of Physics-Based Optical Neural Networks

We report recent research on computing with biology-based neural network...