Robust Generative Restricted Kernel Machines using Weighted Conjugate Feature Duality

02/04/2020
by   Arun Pandey, et al.
0

In the past decade, interest in generative models has grown tremendously. However, their training performance can be highly affected by contamination, where outliers are encoded in the representation of the model. This results in the generation of noisy data. In this paper, we introduce a weighted conjugate feature duality in the framework of Restricted Kernel Machines (RKMs). This formulation is used to fine-tune the latent space of generative RKMs using a weighting function based on the Minimum Covariance Determinant, which is a highly robust estimator of multivariate location and scatter. Experiments show that the weighted RKM is capable of generating clean images when contamination is present in the training data. We further show that the robust method also preserves uncorrelated feature learning through qualitative and quantitative experiments on standard datasets.

READ FULL TEXT

page 5

page 6

research
06/19/2019

Generative Restricted Kernel Machines

We propose a novel method for estimating generative models based on the ...
research
05/28/2021

Latent Space Exploration Using Generative Kernel PCA

Kernel PCA is a powerful feature extractor which recently has seen a ref...
research
08/07/2020

Outlier detection in non-elliptical data by kernel MRCD

The minimum regularized covariance determinant method (MRCD) is a robust...
research
02/01/2014

Dual-to-kernel learning with ideals

In this paper, we propose a theory which unifies kernel learning and sym...
research
07/23/2022

Tensor-based Multi-view Spectral Clustering via Shared Latent Space

Multi-view Spectral Clustering (MvSC) attracts increasing attention due ...
research
06/12/2023

Combining Primal and Dual Representations in Deep Restricted Kernel Machines Classifiers

In contrast to deep networks, kernel methods cannot directly take advant...
research
11/25/2020

Unsupervised learning of disentangled representations in deep restricted kernel machines with orthogonality constraints

We introduce Constr-DRKM, a deep kernel method for the unsupervised lear...

Please sign up or login with your details

Forgot password? Click here to reset