A posteriori noise estimation in variable data sets

12/06/2017
by   S. Czesla, et al.
0

Most physical data sets contain a stochastic contribution produced by measurement noise or other random sources along with the signal. Usually, neither the signal nor the noise are accurately known prior to the measurement so that both have to be estimated a posteriori. We have studied a procedure to estimate the standard deviation of the stochastic contribution assuming normality and independence, requiring a sufficiently well-sampled data set to yield reliable results. This procedure is based on estimating the standard deviation in a sample of weighted sums of arbitrarily sampled data points and is identical to the so-called DER_SNR algorithm for specific parameter settings. To demonstrate the applicability of our procedure, we present applications to synthetic data, high-resolution spectra, and a large sample of space-based light curves and, finally, give guidelines to apply the procedure in situation not explicitly considered here to promote its adoption in data analysis.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/11/2018

Bayesian Spectral Deconvolution Based on Poisson Distribution: Bayesian Measurement and Virtual Measurement Analytics (VMA)

In this paper, we propose a new method of Bayesian measurement for spect...
research
05/17/2018

Fixed-PSNR Lossy Compression for Scientific Data

Error-controlled lossy compression has been studied for years because of...
research
01/30/2015

Downscaling Microwave Brightness Temperatures Using Self Regularized Regressive Models

A novel algorithm is proposed to downscale microwave brightness temperat...
research
01/13/2022

Fully Adaptive Bayesian Algorithm for Data Analysis, FABADA

The aim of this paper is to describe a novel non-parametric noise reduct...
research
01/19/2021

Multi-target detection with rotations

We consider the multi-target detection problem of estimating a two-dimen...
research
10/20/2018

Estimating the Number of Sources: An Efficient Maximization Approach

Estimating the number of sources received by an antenna array have been ...

Please sign up or login with your details

Forgot password? Click here to reset