Semi-supervised classification by reaching consensus among modalities

05/23/2018
by   Zining Zhu, et al.
0

This paper introduces transductive consensus network (TCNs), as an extension of a consensus network (CN), for semi-supervised learning. TCN does multi-modal classification based on a few available labels by urging the interpretations of different modalities to resemble each other. We formulate the multi-modal, semi-supervised learning problem, put forward TCN for multi-modal semi-supervised learning task, and its several variants. To understand the mechanisms of TCN, we formulate the similarity of the interpretations as the negative relative Jensen-Shannon divergence, and show that a consensus state beneficial for classification desires a stable but not perfect similarity between the interpretations. We show the performances of TCN are better than best benchmark algorithms given only 20 and 80 labeled samples on Bank Marketing and the DementiaBank dataset respectively, and align with their performances given more labeled samples.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/21/2023

Missing Modality Robustness in Semi-Supervised Multi-Modal Semantic Segmentation

Using multiple spatial modalities has been proven helpful in improving s...
research
10/02/2020

Semi-Supervised Learning for Multi-Task Scene Understanding by Neural Graph Consensus

We address the challenging problem of semi-supervised learning in the co...
research
11/17/2020

Neural Semi-supervised Learning for Text Classification Under Large-Scale Pretraining

The goal of semi-supervised learning is to utilize the unlabeled, in-dom...
research
04/25/2017

Semi-supervised Bayesian Deep Multi-modal Emotion Recognition

In emotion recognition, it is difficult to recognize human's emotional s...
research
07/14/2020

TCGM: An Information-Theoretic Framework for Semi-Supervised Multi-Modality Learning

Fusing data from multiple modalities provides more information to train ...
research
03/20/2012

Semi-Supervised Single- and Multi-Domain Regression with Multi-Domain Training

We address the problems of multi-domain and single-domain regression bas...
research
11/13/2017

A Supervised Learning Concept for Reducing User Interaction in Passenger Cars

In this article an automation system for human-machine-interfaces (HMI) ...

Please sign up or login with your details

Forgot password? Click here to reset