Duality in Multi-View Restricted Kernel Machines

05/26/2023
by   Sonny Achten, et al.
0

We propose a unifying setting that combines existing restricted kernel machine methods into a single primal-dual multi-view framework for kernel principal component analysis in both supervised and unsupervised settings. We derive the primal and dual representations of the framework and relate different training and inference algorithms from a theoretical perspective. We show how to achieve full equivalence in primal and dual formulations by rescaling primal variables. Finally, we experimentally validate the equivalence and provide insight into the relationships between different methods on a number of time series data sets by recursively forecasting unseen test data and visualizing the learned features.

READ FULL TEXT

page 7

page 8

research
01/24/2023

Multi-view Kernel PCA for Time series Forecasting

In this paper, we propose a kernel principal component analysis model fo...
research
07/23/2022

Tensor-based Multi-view Spectral Clustering via Shared Latent Space

Multi-view Spectral Clustering (MvSC) attracts increasing attention due ...
research
06/12/2023

Combining Primal and Dual Representations in Deep Restricted Kernel Machines Classifiers

In contrast to deep networks, kernel methods cannot directly take advant...
research
08/02/2021

Automatic Polygon Layout for Primal-Dual Visualization of Hypergraphs

N-ary relationships, which relate N entities where N is not necessarily ...
research
08/27/2021

Learning primal-dual sparse kernel machines

Traditionally, kernel methods rely on the representer theorem which stat...
research
09/03/2019

Duality Regularization for Unsupervised Bilingual Lexicon Induction

Unsupervised bilingual lexicon induction naturally exhibits duality, whi...

Please sign up or login with your details

Forgot password? Click here to reset