Recent Deep Semi-supervised Learning Approaches and Related Works

by   GyeongHo Kim, et al.

The author of this work proposes an overview of the recent semi-supervised learning approaches and related works. Despite the remarkable success of neural networks in various applications, there exist few formidable constraints including the need for a large amount of labeled data. Therefore, semi-supervised learning, which is a learning scheme in which the scarce labels and a larger amount of unlabeled data are utilized to train models (e.g., deep neural networks) is getting more important. Based on the key assumptions of semi-supervised learning, which are the manifold assumption, cluster assumption, and continuity assumption, the work reviews the recent semi-supervised learning approaches. In particular, the methods in regard to using deep neural networks in a semi-supervised learning setting are primarily discussed. In addition, the existing works are first classified based on the underlying idea and explained, and then the holistic approaches that unify the aforementioned ideas are detailed.


page 1

page 2

page 3

page 4


MUSCLE: Strengthening Semi-Supervised Learning Via Concurrent Unsupervised Learning Using Mutual Information Maximization

Deep neural networks are powerful, massively parameterized machine learn...

An Overview of Deep Semi-Supervised Learning

Deep neural networks demonstrated their ability to provide remarkable pe...

Label Propagation for Deep Semi-supervised Learning

Semi-supervised learning is becoming increasingly important because it c...

Self-semi-supervised Learning to Learn from NoisyLabeled Data

The remarkable success of today's deep neural networks highly depends on...

Small Data Challenges in Big Data Era: A Survey of Recent Progress on Unsupervised and Semi-Supervised Methods

Small data challenges have emerged in many learning problems, since the ...

Mining Functionally Related Genes with Semi-Supervised Learning

The study of biological processes can greatly benefit from tools that au...

Dealing with Nuisance Parameters using Machine Learning in High Energy Physics: a Review

In this work we discuss the impact of nuisance parameters on the effecti...