Statistical tools to assess the reliability of self-organizing maps

01/04/2007
by   Eric De Bodt, et al.
0

Results of neural network learning are always subject to some variability, due to the sensitivity to initial conditions, to convergence to local minima, and, sometimes more dramatically, to sampling variability. This paper presents a set of tools designed to assess the reliability of the results of Self-Organizing Maps (SOM), i.e. to test on a statistical basis the confidence we can have on the result of a specific SOM. The tools concern the quantization error in a SOM, and the neighborhood relations (both at the level of a specific pair of observations and globally on the map). As a by-product, these measures also allow to assess the adequacy of the number of units chosen in a map. The tools may also be used to measure objectively how the SOM are less sensitive to non-linear optimization problems (local minima, convergence, etc.) than other neural network models.

READ FULL TEXT
research
10/21/2019

On Distributed Stochastic Gradient Algorithms for Global Optimization

The paper considers the problem of network-based computation of global m...
research
01/12/2019

Eliminating all bad Local Minima from Loss Landscapes without even adding an Extra Unit

Recent work has noted that all bad local minima can be removed from neur...
research
04/26/2017

The loss surface of deep and wide neural networks

While the optimization problem behind deep neural networks is highly non...
research
11/22/2019

When Does Non-Orthogonal Tensor Decomposition Have No Spurious Local Minima?

We study the optimization problem for decomposing d dimensional fourth-o...
research
02/23/2022

On the Omnipresence of Spurious Local Minima in Certain Neural Network Training Problems

We study the loss landscape of training problems for deep artificial neu...
research
08/12/2015

Inappropriate use of L-BFGS, Illustrated on frame field design

L-BFGS is a hill climbing method that is guarantied to converge only for...
research
02/26/2018

Self-organizing maps and generalization: an algorithmic description of Numerosity and Variability Effects

Category, or property generalization is a central function in the human ...

Please sign up or login with your details

Forgot password? Click here to reset