Approximate Nearest Neighbors in Limited Space

06/30/2018
by   Piotr Indyk, et al.
0

We consider the (1+ϵ)-approximate nearest neighbor search problem: given a set X of n points in a d-dimensional space, build a data structure that, given any query point y, finds a point x ∈ X whose distance to y is at most (1+ϵ) _x ∈ Xx-y for an accuracy parameter ϵ∈ (0,1). Our main result is a data structure that occupies only O(ϵ^-2 n (n) (1/ϵ)) bits of space, assuming all point coordinates are integers in the range {-n^O(1)... n^O(1)}, i.e., the coordinates have O( n) bits of precision. This improves over the best previously known space bound of O(ϵ^-2 n (n)^2), obtained via the randomized dimensionality reduction method of Johnson and Lindenstrauss (1984). We also consider the more general problem of estimating all distances from a collection of query points to all data points X, and provide almost tight upper and lower bounds for the space complexity of this problem.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/26/2018

Approximate Nearest Neighbor Search in High Dimensions

The nearest neighbor problem is defined as follows: Given a set P of n p...
research
11/05/2017

Practical Data-Dependent Metric Compression with Provable Guarantees

We introduce a new distance-preserving compact representation of multi-d...
research
09/17/2016

ADAGIO: Fast Data-aware Near-Isometric Linear Embeddings

Many important applications, including signal reconstruction, parameter ...
research
02/12/2020

On the I/O complexity of the k-nearest neighbor problem

We consider static, external memory indexes for exact and approximate ve...
research
05/15/2020

Efficient Distributed Algorithms for the K-Nearest Neighbors Problem

The K-nearest neighbors is a basic problem in machine learning with nume...
research
02/12/2018

On the Needs for Rotations in Hypercubic Quantization Hashing

The aim of this paper is to endow the well-known family of hypercubic qu...
research
06/06/2019

Near Neighbor: Who is the Fairest of Them All?

In this work we study a fair variant of the near neighbor problem. Namel...

Please sign up or login with your details

Forgot password? Click here to reset