New Nearly-Optimal Coreset for Kernel Density Estimation

07/15/2020
āˆ™
by   Wai Ming Tai, et al.
āˆ™
0
āˆ™

Given a point set PāŠ‚ā„^d, kernel density estimation for Gaussian kernel is defined as š’¢_P(x) = 1/|P|āˆ‘_pāˆˆ Pe^-ā€– x-p ā€–^2 for any xāˆˆā„^d. We study how to construct a small subset Q of P such that the kernel density estimation of P can be approximated by the kernel density estimation of Q. This subset Q is called coreset. The primary technique in this work is to construct Ā± 1 coloring on the point set P by the discrepancy theory and apply this coloring algorithm recursively. Our result leverages Banaszczyk's Theorem. When d>1 is constant, our construction gives a coreset of size O(1/Īµāˆš(loglog1/Īµ)) as opposed to the best-known result of O(1/Īµāˆš(log1/Īµ)). It is the first to give a breakthrough on the barrier of āˆš(log) factor even when d=2.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
āˆ™ 02/15/2021

Signed variable optimal kernel for non-parametric density estimation

We derive the optimal signed variable in general case kernels for the cl...
research
āˆ™ 05/14/2018

A One-Class Decision Tree Based on Kernel Density Estimation

One-Class Classification (OCC) is a domain of machine learning which ach...
research
āˆ™ 09/23/2019

PDE-Inspired Algorithms for Semi-Supervised Learning on Point Clouds

Given a data set and a subset of labels the problem of semi-supervised l...
research
āˆ™ 06/11/2019

Discrepancy, Coresets, and Sketches in Machine Learning

This paper defines the notion of class discrepancy for families of funct...
research
āˆ™ 10/11/2017

Improved Coresets for Kernel Density Estimates

We study the construction of coresets for kernel density estimates. That...
research
āˆ™ 08/21/2012

Iterative graph cuts for image segmentation with a nonlinear statistical shape prior

Shape-based regularization has proven to be a useful method for delineat...
research
āˆ™ 09/23/2015

Density Estimation via Discrepancy

Given i.i.d samples from some unknown continuous density on hyper-rectan...

Please sign up or login with your details

Forgot password? Click here to reset