Hole or grain? A Section Pursuit Index for Finding Hidden Structure in Multiple Dimensions

04/28/2020
by   Ursula Laa, et al.
Monash University
0

Multivariate data is often visualized using linear projections, produced by techniques such as principal component analysis, linear discriminant analysis, and projection pursuit. A problem with projections is that they obscure low and high density regions near the center of the distribution. Sections, or slices, can help to reveal them. This paper develops a section pursuit method, building on the extensive work in projection pursuit, to search for interesting slices of the data. Linear projections are used to define sections of the parameter space, and to calculate interestingness by comparing the distribution of observations, inside and outside a section. By optimizing this index, it is possible to reveal features such as holes (low density) or grains (high density). The optimization is incorporated into a guided tour so that the search for structure can be dynamic. The approach can be useful for problems when data distributions depart from uniform or normal, as in visually exploring nonlinear manifolds, and functions in multivariate space. Two applications of section pursuit are shown: exploring decision boundaries from classification models, and exploring subspaces induced by complex inequality conditions from multiple parameter model. The new methods are available in R, in the tourr package.

READ FULL TEXT VIEW PDF

page 3

page 6

page 13

page 15

page 16

page 18

04/08/2021

Visual Diagnostics for Constrained Optimisation with Application to Guided Tours

A guided tour helps to visualise high-dimensional data by showing low-di...
02/01/2019

Using tours to visually investigate properties of new projection pursuit indexes with application to problems in physics

Projection pursuit is used to find interesting low-dimensional projectio...
12/22/2021

Refining Invariant Coordinate Selection via Local Projection Pursuit

Independent component selection (ICS), introduced by Tyler et al. (2009,...
09/09/2021

Kurtosis-based projection pursuit for matrix-valued data

We develop projection pursuit for data that admit a natural representati...
03/31/2011

Auto-associative models, nonlinear Principal component analysis, manifolds and projection pursuit

In this paper, auto-associative models are proposed as candidates to the...
12/27/2019

Projection pursuit based on Gaussian mixtures and evolutionary algorithms

We propose a projection pursuit (PP) algorithm based on Gaussian mixture...
07/31/2019

Projection pursuit based generalized betas accounting for higher order co-moment effects in financial market analysis

Betas are possibly the most frequently applied tool to analyze how secur...