Understand and Improve Contrastive Learning Methods for Visual Representation: A Review

06/06/2021
by   Ran Liu, et al.
0

Traditional supervised learning methods are hitting a bottleneck because of their dependency on expensive manually labeled data and their weaknesses such as limited generalization ability and vulnerability to adversarial attacks. A promising alternative, self-supervised learning, as a type of unsupervised learning, has gained popularity because of its potential to learn effective data representations without manual labeling. Among self-supervised learning algorithms, contrastive learning has achieved state-of-the-art performance in several fields of research. This literature review aims to provide an up-to-date analysis of the efforts of researchers to understand the key components and the limitations of self-supervised learning.

READ FULL TEXT
research
06/15/2020

Self-supervised Learning: Generative or Contrastive

Deep supervised learning has achieved great success in the last decade. ...
research
11/03/2021

Recent Advancements in Self-Supervised Paradigms for Visual Feature Representation

We witnessed a massive growth in the supervised learning paradigm in the...
research
08/08/2022

Self-Supervised Contrastive Representation Learning for 3D Mesh Segmentation

3D deep learning is a growing field of interest due to the vast amount o...
research
10/24/2022

Non-Contrastive Learning-based Behavioural Biometrics for Smart IoT Devices

Behaviour biometrics are being explored as a viable alternative to overc...
research
03/17/2023

Contrastive Self-supervised Learning in Recommender Systems: A Survey

Deep learning-based recommender systems have achieved remarkable success...
research
09/21/2023

DimCL: Dimensional Contrastive Learning For Improving Self-Supervised Learning

Self-supervised learning (SSL) has gained remarkable success, for which ...
research
05/26/2023

Unsupervised Embedding Quality Evaluation

Unsupervised learning has recently significantly gained in popularity, e...

Please sign up or login with your details

Forgot password? Click here to reset