Invertible Kernel PCA with Random Fourier Features

03/09/2023
by   Daniel Gedon, et al.
0

Kernel principal component analysis (kPCA) is a widely studied method to construct a low-dimensional data representation after a nonlinear transformation. The prevailing method to reconstruct the original input signal from kPCA – an important task for denoising – requires us to solve a supervised learning problem. In this paper, we present an alternative method where the reconstruction follows naturally from the compression step. We first approximate the kernel with random Fourier features. Then, we exploit the fact that the nonlinear transformation is invertible in a certain subdomain. Hence, the name invertible kernel PCA (ikPCA). We experiment with different data modalities and show that ikPCA performs similarly to kPCA with supervised reconstruction on denoising tasks, making it a strong alternative.

READ FULL TEXT

page 3

page 8

research
08/02/2018

Streaming Kernel PCA with Õ(√(n)) Random Features

We study the statistical and computational aspects of kernel principal c...
research
09/12/2021

Kernel PCA with the Nyström method

Kernel methods are powerful but computationally demanding techniques for...
research
04/03/2022

Robust PCA for High Dimensional Data based on Characteristic Transformation

In this paper, we propose a novel robust Principal Component Analysis (P...
research
06/07/2023

Yet Another Algorithm for Supervised Principal Component Analysis: Supervised Linear Centroid-Encoder

We propose a new supervised dimensionality reduction technique called Su...
research
06/18/2012

A Linear Approximation to the chi^2 Kernel with Geometric Convergence

We propose a new analytical approximation to the χ^2 kernel that converg...
research
03/29/2023

Improvement of variables interpretability in kernel PCA

Kernel methods have been proven to be a powerful tool for the integratio...
research
10/22/2017

Elliptical modeling and pattern analysis for perturbation models and classfication

The characteristics (or numerical patterns) of a feature vector in the t...

Please sign up or login with your details

Forgot password? Click here to reset