Deep Prior

12/13/2017
by   Alexandre Lacoste, et al.
0

The recent literature on deep learning offers new tools to learn a rich probability distribution over high dimensional data such as images or sounds. In this work we investigate the possibility of learning the prior distribution over neural network parameters using such tools. Our resulting variational Bayes algorithm generalizes well to new tasks, even when very few training examples are provided. Furthermore, this learned prior allows the model to extrapolate correctly far from a given task's training data on a meta-dataset of periodic signals.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/10/2022

PCENet: High Dimensional Surrogate Modeling for Learning Uncertainty

Learning data representations under uncertainty is an important task tha...
12/31/2017

Using Deep Neural Network Approximate Bayesian Network

We present a new method to approximate posterior probabilities of Bayesi...
05/30/2019

Meta Dropout: Learning to Perturb Features for Generalization

A machine learning model that generalizes well should obtain low errors ...
05/26/2018

Geometric Understanding of Deep Learning

Deep learning is the mainstream technique for many machine learning task...
05/13/2019

Precipitation nowcasting using a stochastic variational frame predictor with learned prior distribution

We propose the use of a stochastic variational frame prediction deep neu...
12/20/2019

Learned Feature Attribution Priors

Deep learning models have achieved breakthrough successes in domains whe...
12/01/2021

Using Deep Image Prior to Assist Variational Selective Segmentation Deep Learning Algorithms

Variational segmentation algorithms require a prior imposed in the form ...