Approximate Similarity Search Under Edit Distance Using Locality-Sensitive Hashing

07/02/2019
by   Samuel McCauley, et al.
0

Edit distance similarity search, also called approximate pattern matching, is a fundamental problem with widespread applications. The goal of the problem is to preprocess n strings of length d to quickly answer queries q of the form: if there is a database string within edit distance r of q, return a database string within edit distance cr of q. A data structure solving this problem is analyzed using two criteria: the amount of extra space used in preprocessing, and the expected time to answer a query. Previous approaches to this problem have either used trie-based methods, which give exact solutions at the cost of expensive queries, or embeddings, which only work for large (superconstant) values of c. In this work we achieve the first bounds for any approximation factor c, via a simple and easy-to-implement hash function. This gives a running time of Õ(d3^rn^1/c), with space Õ(3^r n^1 + 1/c + dn). We show how to apply these ideas to the closely-related Approximate Nearest Neighbor problem for edit distance, obtaining similar time bounds.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/20/2021

Does Preprocessing help in Fast Sequence Comparisons?

We study edit distance computation with preprocessing: the preprocessing...
research
08/18/2022

Algorithm to derive shortest edit script using Levenshtein distance algorithm

String similarity, longest common subsequence and shortest edit scripts ...
research
03/20/2023

On the Maximal Independent Sets of k-mers with the Edit Distance

In computational biology, k-mers and edit distance are fundamental conce...
research
01/31/2020

Edit Distance Embedding using Convolutional Neural Networks

Edit-distance-based string similarity search has many applications such ...
research
12/29/2015

Analyzing Walter Skeat's Forty-Five Parallel Extracts of William Langland's Piers Plowman

Walter Skeat published his critical edition of William Langland's 14th c...
research
06/07/2022

Locality-sensitive bucketing functions for the edit distance

Many bioinformatics applications involve bucketing a set of sequences wh...
research
06/16/2018

TrQuery: An Embedding-based Framework for Recommanding SPARQL Queries

In this paper, we present an embedding-based framework (TrQuery) for rec...

Please sign up or login with your details

Forgot password? Click here to reset