Understanding and Generalizing Monotonic Proximity Graphs for Approximate Nearest Neighbor Search

07/27/2021
by   Dantong Zhu, et al.
0

Graph-based algorithms have shown great empirical potential for the approximate nearest neighbor (ANN) search problem. Currently, graph-based ANN search algorithms are designed mainly using heuristics, whereas theoretical analysis of such algorithms is quite lacking. In this paper, we study a fundamental model of proximity graphs used in graph-based ANN search, called Monotonic Relative Neighborhood Graph (MRNG), from a theoretical perspective. We use mathematical proofs to explain why proximity graphs that are built based on MRNG tend to have good searching performance. We also run experiments on MRNG and graphs generalizing MRNG to obtain a deeper understanding of the model. Our experiments give guidance on how to approximate and generalize MRNG to build proximity graphs on a large scale. In addition, we discover and study a hidden structure of MRNG called conflicting nodes, and we give theoretical evidence how conflicting nodes could be used to improve ANN search methods that are based on MRNG.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/10/2023

A Theoretical Analysis Of Nearest Neighbor Search On Approximate Near Neighbor Graph

Graph-based algorithms have demonstrated state-of-the-art performance in...
research
06/22/2022

Proximity Graph Maintenance for Fast Online Nearest Neighbor Search

Approximate Nearest Neighbor (ANN) search is a fundamental technique for...
research
06/13/2023

Practice with Graph-based ANN Algorithms on Sparse Data: Chi-square Two-tower model, HNSW, Sign Cauchy Projections

Sparse data are common. The traditional “handcrafted” features are often...
research
01/10/2022

Tree-based Search Graph for Approximate Nearest Neighbor Search

Nearest neighbor search supports important applications in many domains,...
research
12/11/2013

Fast Neighborhood Graph Search using Cartesian Concatenation

In this paper, we propose a new data structure for approximate nearest n...
research
03/30/2016

Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphs

We present a new algorithm for the approximate K-nearest neighbor search...
research
08/22/2022

Generalized Relative Neighborhood Graph (GRNG) for Similarity Search

Similarity search is a fundamental building block for information retrie...

Please sign up or login with your details

Forgot password? Click here to reset