Emergent limits of an indirect measurement from phase transitions of inference

01/05/2020
by   Satoru Tokuda, et al.
0

Measurements are inseparable from inference, where the estimation of signals of interest from other observations is called an indirect measurement. While a variety of measurement limits have been defined by the physical constraint on each setup, the fundamental limit of an indirect measurement is essentially the limit of inference. Here, we propose the concept of statistical limits on indirect measurement: the bounds of distinction between signals and noise and between a signal and another signal. By developing the asymptotic theory of Bayesian regression, we investigate the phenomenology of a typical indirect measurement and demonstrate the existence of these limits. Based on the connection between inference and statistical physics, we also provide a unified interpretation in which these limits emerge from phase transitions of inference. Our results could pave the way for novel experimental design, enabling assess to the required quality of observations according to the assumed ground truth before the concerned indirect measurement is actually performed.

READ FULL TEXT
research
11/08/2015

Statistical physics of inference: Thresholds and algorithms

Many questions of fundamental interest in todays science can be formulat...
research
09/09/2019

Signal retrieval with measurement system knowledge using variational generative model

Signal retrieval from a series of indirect measurements is a common task...
research
11/30/2016

Comparing Apples and Oranges: Two Examples of the Limits of Statistical Inference, With an Application to Google Advertising Markets

We show how the classic Cramer-Rao bound limits how accurately one can s...
research
12/03/2018

Iterative Potts minimization for the recovery of signals with discontinuities from indirect measurements -- the multivariate case

Signals and images with discontinuities appear in many problems in such ...
research
01/18/2016

Statistical Mechanics of High-Dimensional Inference

To model modern large-scale datasets, we need efficient algorithms to in...
research
02/09/2019

The empirical process of residuals from an inverse regression

In this paper we investigate an indirect regression model characterized ...
research
06/15/2020

Learnability with Indirect Supervision Signals

Learning from indirect supervision signals is important in real-world AI...

Please sign up or login with your details

Forgot password? Click here to reset