Latent Space Exploration Using Generative Kernel PCA

05/28/2021
by   David Winant, et al.
10

Kernel PCA is a powerful feature extractor which recently has seen a reformulation in the context of Restricted Kernel Machines (RKMs). These RKMs allow for a representation of kernel PCA in terms of hidden and visible units similar to Restricted Boltzmann Machines. This connection has led to insights on how to use kernel PCA in a generative procedure, called generative kernel PCA. In this paper, the use of generative kernel PCA for exploring latent spaces of datasets is investigated. New points can be generated by gradually moving in the latent space, which allows for an interpretation of the components. Firstly, examples of this feature space exploration on three datasets are shown with one of them leading to an interpretable representation of ECG signals. Afterwards, the use of the tool in combination with novelty detection is shown, where the latent space around novel patterns in the data is explored. This helps in the interpretation of why certain points are considered as novel.

READ FULL TEXT

page 4

page 5

page 6

page 8

page 10

research
06/12/2020

Disentangled Representation Learning and Generation with Manifold Optimization

Disentanglement is an enjoyable property in representation learning whic...
research
06/12/2023

Combining Primal and Dual Representations in Deep Restricted Kernel Machines Classifiers

In contrast to deep networks, kernel methods cannot directly take advant...
research
02/04/2020

Robust Generative Restricted Kernel Machines using Weighted Conjugate Feature Duality

In the past decade, interest in generative models has grown tremendously...
research
06/19/2019

Generative Restricted Kernel Machines

We propose a novel method for estimating generative models based on the ...
research
05/15/2011

Spectrum Sensing for Cognitive Radio Using Kernel-Based Learning

Kernel method is a very powerful tool in machine learning. The trick of ...
research
03/02/2018

Unsupervised Learning of Goal Spaces for Intrinsically Motivated Goal Exploration

Intrinsically motivated goal exploration algorithms enable machines to d...
research
07/23/2022

Tensor-based Multi-view Spectral Clustering via Shared Latent Space

Multi-view Spectral Clustering (MvSC) attracts increasing attention due ...

Please sign up or login with your details

Forgot password? Click here to reset