Robust Matrix Elastic Net based Canonical Correlation Analysis: An Effective Algorithm for Multi-View Unsupervised Learning

by   Peng-Bo Zhang, et al.

This paper presents a robust matrix elastic net based canonical correlation analysis (RMEN-CCA) for multiple view unsupervised learning problems, which emphasizes the combination of CCA and the robust matrix elastic net (RMEN) used as coupled feature selection. The RMEN-CCA leverages the strength of the RMEN to distill naturally meaningful features without any prior assumption and to measure effectively correlations between different 'views'. We can further employ directly the kernel trick to extend the RMEN-CCA to the kernel scenario with theoretical guarantees, which takes advantage of the kernel trick for highly complicated nonlinear feature learning. Rather than simply incorporating existing regularization minimization terms into CCA, this paper provides a new learning paradigm for CCA and is the first to derive a coupled feature selection based CCA algorithm that guarantees convergence. More significantly, for CCA, the newly-derived RMEN-CCA bridges the gap between measurement of relevance and coupled feature selection. Moreover, it is nontrivial to tackle directly the RMEN-CCA by previous optimization approaches derived from its sophisticated model architecture. Therefore, this paper further offers a bridge between a new optimization problem and an existing efficient iterative approach. As a consequence, the RMEN-CCA can overcome the limitation of CCA and address large-scale and streaming data problems. Experimental results on four popular competing datasets illustrate that the RMEN-CCA performs more effectively and efficiently than do state-of-the-art approaches.


page 7

page 8


A simple yet efficient algorithm for multiple kernel learning under elastic-net constraints

This report presents an algorithm for the solution of multiple kernel le...

Identifying The Most Informative Features Using A Structurally Interacting Elastic Net

Feature selection can efficiently identify the most informative features...

Adaptive Collaborative Similarity Learning for Unsupervised Multi-view Feature Selection

In this paper, we investigate the research problem of unsupervised multi...

Joint Multi-view Unsupervised Feature Selection and Graph Learning

Despite the recent progress, the existing multi-view unsupervised featur...

MvFS: Multi-view Feature Selection for Recommender System

Feature selection, which is a technique to select key features in recomm...

Multi-view Sparse Laplacian Eigenmaps for nonlinear Spectral Feature Selection

The complexity of high-dimensional datasets presents significant challen...

An Experiment Design Paradigm using Joint Feature Selection and Task Optimization

This paper presents a subsampling-task paradigm for data-driven task-spe...

Please sign up or login with your details

Forgot password? Click here to reset