Statistical applications of contrastive learning

04/29/2022
by   Michael U. Gutmann, et al.
0

The likelihood function plays a crucial role in statistical inference and experimental design. However, it is computationally intractable for several important classes of statistical models, including energy-based models and simulator-based models. Contrastive learning is an intuitive and computationally feasible alternative to likelihood-based learning. We here first provide an introduction to contrastive learning and then show how we can use it to derive methods for diverse statistical problems, namely parameter estimation for energy-based models, Bayesian inference for simulator-based models, as well as experimental design.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/22/2022

Nonparametric likelihood-free inference with Jensen-Shannon divergence for simulator-based models with categorical output

Likelihood-free inference for simulator-based statistical models has rec...
research
07/04/2017

Learning Deep Energy Models: Contrastive Divergence vs. Amortized MLE

We propose a number of new algorithms for learning deep energy models an...
research
11/05/2020

Contrastive Topographic Models: Energy-based density models applied to the understanding of sensory coding and cortical topography

We address the problem of building theoretical models that help elucidat...
research
05/24/2023

Contrastive Training of Complex-Valued Autoencoders for Object Discovery

Current state-of-the-art object-centric models use slots and attention-b...
research
02/10/2020

On Contrastive Learning for Likelihood-free Inference

Likelihood-free methods perform parameter inference in stochastic simula...
research
11/03/2022

Self-Adapting Noise-Contrastive Estimation for Energy-Based Models

Training energy-based models (EBMs) with noise-contrastive estimation (N...
research
02/23/2018

Kernel Recursive ABC: Point Estimation with Intractable Likelihood

We propose a novel approach to parameter estimation for simulator-based ...

Please sign up or login with your details

Forgot password? Click here to reset