Empirical Bayes approach to Truth Discovery problems

06/09/2022
by   Tsviel Ben Shabat, et al.
0

When aggregating information from conflicting sources, one's goal is to find the truth. Most real-value truth discovery (TD) algorithms try to achieve this goal by estimating the competence of each source and then aggregating the conflicting information by weighing each source's answer proportionally to her competence. However, each of those algorithms requires more than a single source for such estimation and usually does not consider different estimation methods other than a weighted mean. Therefore, in this work we formulate, prove, and empirically test the conditions for an Empirical Bayes Estimator (EBE) to dominate the weighted mean aggregation. Our main result demonstrates that EBE, under mild conditions, can be used as a second step of any TD algorithm in order to reduce the expected error.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/07/2017

SmartMTD: A Graph-Based Approach for Effective Multi-Truth Discovery

The Big Data era features a huge amount of data that are contributed by ...
research
10/13/2019

Empirical and Constrained Empirical Bayes Variance Estimation Under A One Unit Per Stratum Sample Design

A single primary sampling unit (PSU) per stratum design is a popular des...
research
02/16/2017

An Empirical Bayes Approach for High Dimensional Classification

We propose an empirical Bayes estimator based on Dirichlet process mixtu...
research
07/27/2018

Combining Restricted Boltzmann Machines with Neural Networks for Latent Truth Discovery

Latent truth discovery, LTD for short, refers to the problem of aggregat...
research
11/30/2017

Bayes Minimax Competitors of Preliminary Test Estimators in k Sample Problems

In this paper, we consider the estimation of a mean vector of a multivar...
research
04/23/2019

Crowdsourced Truth Discovery in the Presence of Hierarchies for Knowledge Fusion

Existing works for truth discovery in categorical data usually assume th...
research
06/04/2019

Covariate-Powered Empirical Bayes Estimation

We study methods for simultaneous analysis of many noisy experiments in ...

Please sign up or login with your details

Forgot password? Click here to reset