SAH: Shifting-aware Asymmetric Hashing for Reverse k-Maximum Inner Product Search

11/23/2022
by   Qiang Huang, et al.
0

This paper investigates a new yet challenging problem called Reverse k-Maximum Inner Product Search (RkMIPS). Given a query (item) vector, a set of item vectors, and a set of user vectors, the problem of RkMIPS aims to find a set of user vectors whose inner products with the query vector are one of the k largest among the query and item vectors. We propose the first subquadratic-time algorithm, i.e., Shifting-aware Asymmetric Hashing (SAH), to tackle the RkMIPS problem. To speed up the Maximum Inner Product Search (MIPS) on item vectors, we design a shifting-invariant asymmetric transformation and develop a novel sublinear-time Shifting-Aware Asymmetric Locality Sensitive Hashing (SA-ALSH) scheme. Furthermore, we devise a new blocking strategy based on the Cone-Tree to effectively prune user vectors (in a batch). We prove that SAH achieves a theoretical guarantee for solving the RMIPS problem. Experimental results on five real-world datasets show that SAH runs 4∼8× faster than the state-of-the-art methods for RkMIPS while achieving F1-scores of over 90%. The code is available at <https://github.com/HuangQiang/SAH>.

READ FULL TEXT
research
10/14/2021

Reverse Maximum Inner Product Search: How to efficiently find users who would like to buy my item?

The MIPS (maximum inner product search), which finds the item with the h...
research
05/22/2014

Asymmetric LSH (ALSH) for Sublinear Time Maximum Inner Product Search (MIPS)

We present the first provably sublinear time algorithm for approximate M...
research
10/20/2014

Improved Asymmetric Locality Sensitive Hashing (ALSH) for Maximum Inner Product Search (MIPS)

Recently it was shown that the problem of Maximum Inner Product Search (...
research
11/14/2014

Asymmetric Minwise Hashing

Minwise hashing (Minhash) is a widely popular indexing scheme in practic...
research
12/06/2016

Binary Subspace Coding for Query-by-Image Video Retrieval

The query-by-image video retrieval (QBIVR) task has been attracting cons...
research
01/14/2023

Weighted Minwise Hashing Beats Linear Sketching for Inner Product Estimation

We present a new approach for computing compact sketches that can be use...
research
12/21/2020

Sublinear Maximum Inner Product Search using Concomitants of Extreme Order Statistics

We propose a novel dimensionality reduction method for maximum inner pro...

Please sign up or login with your details

Forgot password? Click here to reset