Visual Diagnostics for Constrained Optimisation with Application to Guided Tours

by   H. Sherry Zhang, et al.

A guided tour helps to visualise high-dimensional data by showing low-dimensional projections along a projection pursuit optimisation path. Projection pursuit is a generalisation of principal component analysis, in the sense that different indexes are used to define the interestingness of the projected data. While much work has been done in developing new indexes in the literature, less has been done on understanding the optimisation. Index functions can be noisy, might have multiple local maxima as well as an optimal maximum, and are constrained to generate orthonormal projection frames, which complicates the optimization. In addition, projection pursuit is primarily used for exploratory data analysis, and finding the local maxima is also useful. The guided tour is especially useful for exploration, because it conducts geodesic interpolation connecting steps in the optimisation and shows how the projected data changes as a maxima is approached. This work provides new visual diagnostics for examining a choice of optimisation procedure, based on the provision of a new data object which collects information throughout the optimisation. It has helped to diagnose and fix several problems with projection pursuit guided tour. This work might be useful more broadly for diagnosing optimisers, and comparing their performance. The diagnostics are implemented in the R package, ferrn.


Hole or grain? A Section Pursuit Index for Finding Hidden Structure in Multiple Dimensions

Multivariate data is often visualized using linear projections, produced...

Using tours to visually investigate properties of new projection pursuit indexes with application to problems in physics

Projection pursuit is used to find interesting low-dimensional projectio...

Minimum Spectral Connectivity Projection Pursuit

We study the problem of determining the optimal low dimensional projecti...

A New Algorithm for Exploratory Projection Pursuit

In this paper, we propose a new algorithm for exploratory projection pur...

Human-guided data exploration using randomisation

An explorative data analysis system should be aware of what the user alr...

Fast Kernel Smoothing in R with Applications to Projection Pursuit

This paper introduces the R package FKSUM, which offers fast and exact e...

Overparametrized linear dimensionality reductions: From projection pursuit to two-layer neural networks

Given a cloud of n data points in ℝ^d, consider all projections onto m-d...

Please sign up or login with your details

Forgot password? Click here to reset