DeepAI AI Chat
Log In Sign Up

Physics-based Neural Networks for Shape from Polarization

by   Yunhao Ba, et al.

How should prior knowledge from physics inform a neural network solution? We study the blending of physics and deep learning in the context of Shape from Polarization (SfP). The classic SfP problem recovers an object's shape from polarized photographs of the scene. The SfP problem is special because the physical models are only approximate. Previous attempts to solve SfP have been purely model-based, and are susceptible to errors when real-world conditions deviate from the idealized physics. In our solution, there is a subtlety to combining physics and neural networks. Our final solution blends deep learning with synthetic renderings (derived from physics) in the framework of a two-stage encoder. The lessons learned from this exemplary problem foreshadow the future impact of physics-based learning.


page 1

page 2

page 4

page 5

page 6

page 7

page 8

page 9


How to do Physics-based Learning

The goal of this tutorial is to explain step-by-step how to implement ph...

Phy-Taylor: Physics-Model-Based Deep Neural Networks

Purely data-driven deep neural networks (DNNs) applied to physical engin...

Interpretability Study on Deep Learning for Jet Physics at the Large Hadron Collider

Using deep neural networks for identifying physics objects at the Large ...

Including Physics in Deep Learning -- An example from 4D seismic pressure saturation inversion

Geoscience data often have to rely on strong priors in the face of uncer...

Kohn-Sham equations as regularizer: building prior knowledge into machine-learned physics

Including prior knowledge is important for effective machine learning mo...

Computing by Means of Physics-Based Optical Neural Networks

We report recent research on computing with biology-based neural network...