Bigeometric Organization of Deep Nets

07/01/2015
by   Alexander Cloninger, et al.
0

In this paper, we build an organization of high-dimensional datasets that cannot be cleanly embedded into a low-dimensional representation due to missing entries and a subset of the features being irrelevant to modeling functions of interest. Our algorithm begins by defining coarse neighborhoods of the points and defining an expected empirical function value on these neighborhoods. We then generate new non-linear features with deep net representations tuned to model the approximate function, and re-organize the geometry of the points with respect to the new representation. Finally, the points are locally z-scored to create an intrinsic geometric organization which is independent of the parameters of the deep net, a geometry designed to assure smoothness with respect to the empirical function. We examine this approach on data from the Center for Medicare and Medicaid Services Hospital Quality Initiative, and generate an intrinsic low-dimensional organization of the hospitals that is smooth with respect to an expert driven function of quality.

READ FULL TEXT
research
06/25/2015

Diffusion Nets

Non-linear manifold learning enables high-dimensional data analysis, but...
research
08/05/2019

Efficient Approximation of Deep ReLU Networks for Functions on Low Dimensional Manifolds

Deep neural networks have revolutionized many real world applications, d...
research
11/26/2013

Auto-adaptative Laplacian Pyramids for High-dimensional Data Analysis

Non-linear dimensionality reduction techniques such as manifold learning...
research
10/28/2019

Deep learning is adaptive to intrinsic dimensionality of model smoothness in anisotropic Besov space

Deep learning has exhibited superior performance for various tasks, espe...
research
11/05/2018

Intrinsic Universal Measurements of Non-linear Embeddings

A basic problem in machine learning is to find a mapping f from a low di...
research
06/28/2016

Multi-View Kernel Consensus For Data Analysis and Signal Processing

The input data features set for many data driven tasks is high-dimension...
research
08/27/2019

Constructing a Maturity Model for a Distributed Software Organization

We present early experiences with defining and validating a software mat...

Please sign up or login with your details

Forgot password? Click here to reset