Notes on Icebreaker

04/26/2020
by   , et al.
0

Icebreaker [1] is new research from MSR that is able to achieve state of the art performance on inference in which there is inherent missing data. Using mutual information, Icebreaker is able to suggest which values in the data to impute for maximum benefit. These notes are an amalgamation of information from various articles and tutorials including autoencoders, variational inference, variational autoencoders, the evidence lower bound, set based learning and finally leading to Icebreaker. References are provided whenever appropriate. There may be factual errors and typos in these notes. Please send them to the author.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/05/2018

Doubly Semi-Implicit Variational Inference

We extend the existing framework of semi-implicit variational inference ...
research
06/28/2019

The Thermodynamic Variational Objective

We introduce the thermodynamic variational objective (TVO) for learning ...
research
12/01/2021

Lecture notes on complexity of quantifier elimination over the reals

These are lecture notes for a course I gave in mid-1990s for MSc student...
research
12/01/2020

Mutual Information Constraints for Monte-Carlo Objectives

A common failure mode of density models trained as variational autoencod...
research
04/10/2017

Reinterpreting Importance-Weighted Autoencoders

The standard interpretation of importance-weighted autoencoders is that ...
research
11/17/2020

Recursive Inference for Variational Autoencoders

Inference networks of traditional Variational Autoencoders (VAEs) are ty...
research
03/12/2021

Medical data wrangling with sequential variational autoencoders

Medical data sets are usually corrupted by noise and missing data. These...

Please sign up or login with your details

Forgot password? Click here to reset