Incorporating Unlabelled Data into Bayesian Neural Networks

04/04/2023
by   Mrinank Sharma, et al.
0

We develop a contrastive framework for learning better prior distributions for Bayesian Neural Networks (BNNs) using unlabelled data. With this framework, we propose a practical BNN algorithm that offers the label-efficiency of self-supervised learning and the principled uncertainty estimates of Bayesian methods. Finally, we demonstrate the advantages of our approach for data-efficient learning in semi-supervised and low-budget active learning problems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/03/2019

Bayesian semi-supervised learning for uncertainty-calibrated prediction of molecular properties and active learning

Predicting bioactivity and physical properties of small molecules is a c...
research
09/15/2016

A Tutorial about Random Neural Networks in Supervised Learning

Random Neural Networks (RNNs) are a class of Neural Networks (NNs) that ...
research
09/05/2023

Sparse Function-space Representation of Neural Networks

Deep neural networks (NNs) are known to lack uncertainty estimates and s...
research
05/23/2022

Active Learning Through a Covering Lens

Deep active learning aims to reduce the annotation cost for deep neural ...
research
06/29/2017

Bayesian Semisupervised Learning with Deep Generative Models

Neural network based generative models with discriminative components ar...
research
10/18/2021

A-Optimal Active Learning

In this work we discuss the problem of active learning. We present an ap...
research
12/22/2021

Constraining cosmological parameters from N-body simulations with Bayesian Neural Networks

In this paper, we use The Quijote simulations in order to extract the co...

Please sign up or login with your details

Forgot password? Click here to reset