A Sketching Method for Finding the Closest Point on a Convex Hull

02/21/2021
by   Roozbeh Yousefzadeh, et al.
15

We develop a sketching algorithm to find the point on the convex hull of a dataset, closest to a query point outside it. Studying the convex hull of datasets can provide useful information about their geometric structure and their distribution. Many machine learning datasets have large number of samples with large number of features, but exact algorithms in computational geometry are usually not designed for such setting. Alternatively, the problem can be formulated as a linear least-squares problem with linear constraints. However, solving the problem using standard optimization algorithms can be very expensive for large datasets. Our algorithm uses a sketching procedure to exploit the structure of the data and unburden the optimization process from irrelevant points. This involves breaking the data into pieces and gradually putting the pieces back together, while improving the optimal solution using a gradient project method that can rapidly change its active set of constraints. Our method eventually leads to the optimal solution of our convex problem faster than off-the-shelf algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/08/2020

Project and Forget: Solving Large-Scale Metric Constrained Problems

Given a set of dissimilarity measurements amongst data points, determini...
research
12/07/2022

Generalized Gradient Flows with Provable Fixed-Time Convergence and Fast Evasion of Non-Degenerate Saddle Points

Gradient-based first-order convex optimization algorithms find widesprea...
research
10/14/2018

Convex Hull Approximation of Nearly Optimal Lasso Solutions

In an ordinary feature selection procedure, a set of important features ...
research
06/29/2020

Partitioned Least Squares

In this paper we propose a variant of the linear least squares model all...
research
04/05/2021

Optimal Sampling Gaps for Adaptive Submodular Maximization

Running machine learning algorithms on large and rapidly growing volumes...
research
06/05/2019

Data Sketching for Faster Training of Machine Learning Models

Many machine learning problems reduce to the problem of minimizing an ex...
research
04/23/2020

Point Location and Active Learning: Learning Halfspaces Almost Optimally

Given a finite set X ⊂ℝ^d and a binary linear classifier c: ℝ^d →{0,1}, ...

Please sign up or login with your details

Forgot password? Click here to reset