A Reconstruction Error Formulation for Semi-Supervised Multi-task and Multi-view Learning

02/04/2012
by   Buyue Qian, et al.
0

A significant challenge to make learning techniques more suitable for general purpose use is to move beyond i) complete supervision, ii) low dimensional data, iii) a single task and single view per instance. Solving these challenges allows working with "Big Data" problems that are typically high dimensional with multiple (but possibly incomplete) labelings and views. While other work has addressed each of these problems separately, in this paper we show how to address them together, namely semi-supervised dimension reduction for multi-task and multi-view learning (SSDR-MML), which performs optimization for dimension reduction and label inference in semi-supervised setting. The proposed framework is designed to handle both multi-task and multi-view learning settings, and can be easily adapted to many useful applications. Information obtained from all tasks and views is combined via reconstruction errors in a linear fashion that can be efficiently solved using an alternating optimization scheme. Our formulation has a number of advantages. We explicitly model the information combining mechanism as a data structure (a weight/nearest-neighbor matrix) which allows investigating fundamental questions in multi-task and multi-view learning. We address one such question by presenting a general measure to quantify the success of simultaneous learning of multiple tasks or from multiple views. We show that our SSDR-MML approach can outperform many state-of-the-art baseline methods and demonstrate the effectiveness of connecting dimension reduction and learning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/01/2019

Co-regularized Multi-view Sparse Reconstruction Embedding for Dimension Reduction

With the development of information technology, we have witnessed an age...
research
11/11/2018

Semi-supervised Deep Representation Learning for Multi-View Problems

While neural networks for learning representation of multi-view data hav...
research
07/25/2018

Multi-view Reconstructive Preserving Embedding for Dimension Reduction

With the development of feature extraction technique, one sample always ...
research
05/20/2019

Multi-view Locality Low-rank Embedding for Dimension Reduction

During the last decades, we have witnessed a surge of interests of learn...
research
11/15/2019

The Similarity-Consensus Regularized Multi-view Learning for Dimension Reduction

During the last decades, learning a low-dimensional space with discrimin...
research
11/19/2015

Patterns for Learning with Side Information

Supervised, semi-supervised, and unsupervised learning estimate a functi...
research
09/25/2012

Optimal Weighting of Multi-View Data with Low Dimensional Hidden States

In Natural Language Processing (NLP) tasks, data often has the following...

Please sign up or login with your details

Forgot password? Click here to reset