Unsupervised Learning of the Set of Local Maxima

01/14/2020
by   Lior Wolf, et al.
7

This paper describes a new form of unsupervised learning, whose input is a set of unlabeled points that are assumed to be local maxima of an unknown value function v in an unknown subset of the vector space. Two functions are learned: (i) a set indicator c, which is a binary classifier, and (ii) a comparator function h that given two nearby samples, predicts which sample has the higher value of the unknown function v. Loss terms are used to ensure that all training samples x are a local maxima of v, according to h and satisfy c(x)=1. Therefore, c and h provide training signals to each other: a point x' in the vicinity of x satisfies c(x)=-1 or is deemed by h to be lower in value than x. We present an algorithm, show an example where it is more efficient to use local maxima as an indicator function than to employ conventional classification, and derive a suitable generalization bound. Our experiments show that the method is able to outperform one-class classification algorithms in the task of anomaly detection and also provide an additional signal that is extracted in a completely unsupervised way.

READ FULL TEXT
research
03/05/2017

A Theory of Output-Side Unsupervised Domain Adaptation

When learning a mapping from an input space to an output space, the assu...
research
07/18/2013

Efficient Reinforcement Learning in Deterministic Systems with Value Function Generalization

We consider the problem of reinforcement learning over episodes of a fin...
research
08/11/2022

Unsupervised Face Morphing Attack Detection via Self-paced Anomaly Detection

The supervised-learning-based morphing attack detection (MAD) solutions ...
research
02/13/2023

Unsupervised Deep One-Class Classification with Adaptive Threshold based on Training Dynamics

One-class classification has been a prevailing method in building deep a...
research
06/30/2021

Learning Bounds for Open-Set Learning

Traditional supervised learning aims to train a classifier in the closed...
research
07/31/2020

Rethinking PointNet Embedding for Faster and Compact Model

PointNet, which is the widely used point-wise embedding method and known...
research
06/06/2019

From Caesar Cipher to Unsupervised Learning: A New Method for Classifier Parameter Estimation

Many important classification problems, such as object classification, s...

Please sign up or login with your details

Forgot password? Click here to reset