Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey

04/18/2022
by   Kento Nozawa, et al.
0

Representation learning enables us to automatically extract generic feature representations from a dataset to solve another machine learning task. Recently, extracted feature representations by a representation learning algorithm and a simple predictor have exhibited state-of-the-art performance on several machine learning tasks. Despite its remarkable progress, there exist various ways to evaluate representation learning algorithms depending on the application because of the flexibility of representation learning. To understand the current representation learning, we review evaluation methods of representation learning algorithms and theoretical analyses. On the basis of our evaluation survey, we also discuss the future direction of representation learning. Note that this survey is the extended version of Nozawa and Sato (2022).

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/31/2020

A Survey on Concept Factorization: From Shallow to Deep Representation Learning

The quality of learned features by representation learning determines th...
research
06/24/2012

Representation Learning: A Review and New Perspectives

The success of machine learning algorithms generally depends on data rep...
research
02/04/2023

Feature Representation Learning for Click-through Rate Prediction: A Review and New Perspectives

Representation learning has been a critical topic in machine learning. I...
research
09/01/2020

Improved Bilevel Model: Fast and Optimal Algorithm with Theoretical Guarantee

Due to the hierarchical structure of many machine learning problems, bil...
research
02/12/2018

State Representation Learning for Control: An Overview

Representation learning algorithms are designed to learn abstract featur...
research
02/15/2022

On Representation Learning with Feedback

This note complements the author's recent paper "Robust representation l...
research
10/28/2022

A Survey on Causal Representation Learning and Future Work for Medical Image Analysis

Statistical machine learning algorithms have achieved state-of-the-art r...

Please sign up or login with your details

Forgot password? Click here to reset