MCD: Marginal Contrastive Discrimination for conditional density estimation

06/03/2022
by   Benjamin Riu, et al.
0

We consider the problem of conditional density estimation, which is a major topic of interest in the fields of statistical and machine learning. Our method, called Marginal Contrastive Discrimination, MCD, reformulates the conditional density function into two factors, the marginal density function of the target variable and a ratio of density functions which can be estimated through binary classification. Like noise-contrastive methods, MCD can leverage state-of-the-art supervised learning techniques to perform conditional density estimation, including neural networks. Our benchmark reveals that our method significantly outperforms in practice existing methods on most density models and regression datasets.

READ FULL TEXT

page 34

page 35

research
06/05/2019

Noise Contrastive Meta-Learning for Conditional Density Estimation using Kernel Mean Embeddings

Current meta-learning approaches focus on learning functional representa...
research
06/24/2021

OCDE: Odds Conditional Density Estimator

Conditional density estimation (CDE) models can be useful for many stati...
research
06/10/2018

Conditional Noise-Contrastive Estimation of Unnormalised Models

Many parametric statistical models are not properly normalised and only ...
research
04/09/2013

Symmetry-Aware Marginal Density Estimation

The Rao-Blackwell theorem is utilized to analyze and improve the scalabi...
research
03/03/2019

Conditional Density Estimation with Neural Networks: Best Practices and Benchmarks

Given a set of empirical observations, conditional density estimation ai...
research
06/07/2016

Better Conditional Density Estimation for Neural Networks

The vast majority of the neural network literature focuses on predicting...
research
10/14/2016

Simultaneous Learning of Trees and Representations for Extreme Classification and Density Estimation

We consider multi-class classification where the predictor has a hierarc...

Please sign up or login with your details

Forgot password? Click here to reset