SEVEN: Deep Semi-supervised Verification Networks

06/12/2017
by   Vahid Noroozi, et al.
0

Verification determines whether two samples belong to the same class or not, and has important applications such as face and fingerprint verification, where thousands or millions of categories are present but each category has scarce labeled examples, presenting two major challenges for existing deep learning models. We propose a deep semi-supervised model named SEmi-supervised VErification Network (SEVEN) to address these challenges. The model consists of two complementary components. The generative component addresses the lack of supervision within each category by learning general salient structures from a large amount of data across categories. The discriminative component exploits the learned general features to mitigate the lack of supervision within categories, and also directs the generative component to find more informative structures of the whole data manifold. The two components are tied together in SEVEN to allow an end-to-end training of the two components. Extensive experiments on four verification tasks demonstrate that SEVEN significantly outperforms other state-of-the-art deep semi-supervised techniques when labeled data are in short supply. Furthermore, SEVEN is competitive with fully supervised baselines trained with a larger amount of labeled data. It indicates the importance of the generative component in SEVEN.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/05/2020

Partly Supervised Multitask Learning

Semi-supervised learning has recently been attracting attention as an al...
research
06/03/2017

Learning by Association - A versatile semi-supervised training method for neural networks

In many real-world scenarios, labeled data for a specific machine learni...
research
03/18/2021

MSMatch: Semi-Supervised Multispectral Scene Classification with Few Labels

Supervised learning techniques are at the center of many tasks in remote...
research
10/18/2019

Semi-supervised Learning using Adversarial Training with Good and Bad Samples

In this work, we investigate semi-supervised learning (SSL) for image cl...
research
06/29/2017

Bayesian Semisupervised Learning with Deep Generative Models

Neural network based generative models with discriminative components ar...
research
05/31/2023

Towards Semi-supervised Universal Graph Classification

Graph neural networks have pushed state-of-the-arts in graph classificat...
research
03/27/2019

Small Data Challenges in Big Data Era: A Survey of Recent Progress on Unsupervised and Semi-Supervised Methods

Small data challenges have emerged in many learning problems, since the ...

Please sign up or login with your details

Forgot password? Click here to reset