Deep connections between learning from limited labels physical parameter estimation – inspiration for regularization

03/17/2020
by   Bas Peters, et al.
0

Recently established equivalences between differential equations and the structure of neural networks enabled some interpretation of training of a neural network as partial-differential-equation (PDE) constrained optimization. We add to the previously established connections, explicit regularization that is particularly beneficial in the case of single large-scale examples with partial annotation. We show that explicit regularization of model parameters in PDE constrained optimization translates to regularization of the network output. Examination of the structure of the corresponding Lagrangian and backpropagation algorithm do not reveal additional computational challenges. A hyperspectral imaging example shows that minimum prior information together with cross-validation for optimal regularization parameters boosts the segmentation accuracy.

READ FULL TEXT
research
02/13/2023

Technical Note: PDE-constrained Optimization Formulation for Tumor Growth Model Calibration

We discuss solution algorithms for calibrating a tumor growth model usin...
research
11/20/2019

DPM: A deep learning PDE augmentation method (with application to large-eddy simulation)

Machine learning for scientific applications faces the challenge of limi...
research
02/17/2022

Enhanced DeepONet for Modeling Partial Differential Operators Considering Multiple Input Functions

Machine learning, especially deep learning is gaining much attention due...
research
08/18/2022

CP-PINNs: Changepoints Detection in PDEs using Physics Informed Neural Networks with Total-Variation Penalty

We consider the inverse problem for the Partial Differential Equations (...
research
02/24/2018

Constrained Image Generation Using Binarized Neural Networks with Decision Procedures

We consider the problem of binary image generation with given properties...
research
01/10/2019

Unsupervised Moving Object Detection via Contextual Information Separation

We propose an adversarial contextual model for detecting moving objects ...
research
03/10/2019

Generalized Minkowski sets for the regularization of inverse problems

Many works on inverse problems in the imaging sciences consider regulari...

Please sign up or login with your details

Forgot password? Click here to reset