Morpho-MNIST: Quantitative Assessment and Diagnostics for Representation Learning

09/27/2018
by   Daniel Coelho de Castro, et al.
22

Revealing latent structure in data is an active field of research, having brought exciting new models such as variational autoencoders and generative adversarial networks, and is essential to push machine learning towards unsupervised knowledge discovery. However, a major challenge is the lack of suitable benchmarks for an objective and quantitative evaluation of learned representations. To address this issue we introduce Morpho-MNIST. We extend the popular MNIST dataset by adding a morphometric analysis enabling quantitative comparison of different models, identification of the roles of latent variables, and characterisation of sample diversity. We further propose a set of quantifiable perturbations to assess the performance of unsupervised and supervised methods on challenging tasks such as outlier detection and domain adaptation.

READ FULL TEXT

page 16

page 17

06/14/2021

Graph Domain Adaptation: A Generative View

Recent years have witnessed tremendous interest in deep learning on grap...
12/16/2020

Latent Space Conditioning on Generative Adversarial Networks

Generative adversarial networks are the state of the art approach toward...
12/22/2020

Learning Disentangled Semantic Representation for Domain Adaptation

Domain adaptation is an important but challenging task. Most of the exis...
08/23/2019

Increasing the Generalisaton Capacity of Conditional VAEs

We address the problem of one-to-many mappings in supervised learning, w...
09/27/2017

Generative Adversarial Networks with Inverse Transformation Unit

In this paper we introduce a new structure to Generative Adversarial Net...
04/19/2018

Unsupervised Representation Adversarial Learning Network: from Reconstruction to Generation

A good representation for arbitrarily complicated data should have the c...
06/02/2022

Weakly Supervised Representation Learning with Sparse Perturbations

The theory of representation learning aims to build methods that provabl...

Code Repositories

Morpho-MNIST

Morpho-MNIST: Quantitative Assessment and Diagnostics for Representation Learning (http://jmlr.org/papers/v20/19-033.html)


view repo