Vanishing Component Analysis with Contrastive Normalization

10/27/2022
by   Ryosuke Masuya, et al.
0

Vanishing component analysis (VCA) computes approximate generators of vanishing ideals of samples, which are further used for extracting nonlinear features of the samples. Recent studies have shown that normalization of approximate generators plays an important role and different normalization leads to generators of different properties. In this paper, inspired by recent self-supervised frameworks, we propose a contrastive normalization method for VCA, where we impose the generators to vanish on the target samples and to be normalized on the transformed samples. We theoretically show that a contrastive normalization enhances the discriminative power of VCA, and provide the algebraic interpretation of VCA under our normalization. Numerical experiments demonstrate the effectiveness of our method. This is the first study to tailor the normalization of approximate generators of vanishing ideals to obtain discriminative features.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/02/2021

Border basis computation with gradient-weighted normalization

Normalization of polynomials plays a vital role in the approximate basis...
research
06/04/2018

Self-Normalization Properties of Language Modeling

Self-normalizing discriminative models approximate the normalized probab...
research
12/08/2021

Revisiting Contrastive Learning through the Lens of Neighborhood Component Analysis: an Integrated Framework

As a seminal tool in self-supervised representation learning, contrastiv...
research
02/07/2022

Conditional Gradients for the Approximately Vanishing Ideal

The vanishing ideal of a set of points X⊆ℝ^n is the set of polynomials t...
research
07/01/2016

PyCells for an Open Semiconductor Industry

In the modern semiconductor industry, automatic generation of parameteri...
research
04/21/2023

A Revisit to the Normalized Eight-Point Algorithm and A Self-Supervised Deep Solution

The Normalized Eight-Point algorithm has been widely viewed as the corne...
research
01/01/2021

Monomial-agnostic computation of vanishing ideals

The approximate basis computation of vanishing ideals has recently been ...

Please sign up or login with your details

Forgot password? Click here to reset