A Survey on Self-Supervised Representation Learning

08/22/2023
by   Tobias Uelwer, et al.
0

Learning meaningful representations is at the heart of many tasks in the field of modern machine learning. Recently, a lot of methods were introduced that allow learning of image representations without supervision. These representations can then be used in downstream tasks like classification or object detection. The quality of these representations is close to supervised learning, while no labeled images are needed. This survey paper provides a comprehensive review of these methods in a unified notation, points out similarities and differences of these methods, and proposes a taxonomy which sets these methods in relation to each other. Furthermore, our survey summarizes the most-recent experimental results reported in the literature in form of a meta-study. Our survey is intended as a starting point for researchers and practitioners who want to dive into the field of representation learning.

READ FULL TEXT

page 10

page 19

research
12/24/2020

Self-Supervised Representation Learning for Astronomical Images

Sky surveys are the largest data generators in astronomy, making automat...
research
10/27/2021

A Survey of Self-Supervised and Few-Shot Object Detection

Labeling data is often expensive and time-consuming, especially for task...
research
01/16/2021

Self-Supervised Representation Learning from Flow Equivariance

Self-supervised representation learning is able to learn semantically me...
research
06/18/2022

Neural Shape-from-Shading for Survey-Scale Self-Consistent Bathymetry from Sidescan

Sidescan sonar is a small and cost-effective sensing solution that can b...
research
07/18/2022

ExAgt: Expert-guided Augmentation for Representation Learning of Traffic Scenarios

Representation learning in recent years has been addressed with self-sup...
research
12/12/2018

Recent Advances in Autoencoder-Based Representation Learning

Learning useful representations with little or no supervision is a key c...
research
03/17/2021

Set-to-Sequence Methods in Machine Learning: a Review

Machine learning on sets towards sequential output is an important and u...

Please sign up or login with your details

Forgot password? Click here to reset