Optimal Strategies for Matching and Retrieval Problems by Comparing Covariates

07/12/2018
by   Yandong Wen, et al.
0

In many retrieval problems, where we must retrieve one or more entries from a gallery in response to a probe, it is common practice to learn to do by directly comparing the probe and gallery entries to one another. In many situations the gallery and probe have common covariates -- external variables that are common to both. In principle it is possible to perform the retrieval based merely on these covariates. The process, however, becomes gated by our ability to recognize the covariates for the probe and gallery entries correctly. In this paper we analyze optimal strategies for retrieval based only on matching covariates, when the recognition of the covariates is itself inaccurate. We investigate multiple problems: recovering one item from a gallery of N entries, matching pairs of instances, and retrieval from large collections. We verify our analytical formulae through experiments to verify their correctness in practical settings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/24/2020

Imputation for High-Dimensional Linear Regression

We study high-dimensional regression with missing entries in the covaria...
research
04/23/2020

TCNN: Triple Convolutional Neural Network Models for Retrieval-based Question Answering System in E-commerce

Automatic question-answering (QA) systems have boomed during last few ye...
research
05/03/2017

A Rule-Based Computational Model of Cognitive Arithmetic

Cognitive arithmetic studies the mental processes used in solving math p...
research
09/11/2023

Demystifying Statistical Matching Algorithms for Big Data

Statistical matching is an effective method for estimating causal effect...
research
01/28/2022

Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval

Retrieval-based language models (R-LM) model the probability of natural ...
research
02/23/2022

Semi-Structured Query Grounding for Document-Oriented Databases with Deep Retrieval and Its Application to Receipt and POI Matching

Semi-structured query systems for document-oriented databases have many ...

Please sign up or login with your details

Forgot password? Click here to reset