The Most Informative Order Statistic and its Application to Image Denoising

01/27/2021
by   Alex Dytso, et al.
0

We consider the problem of finding the subset of order statistics that contains the most information about a sample of random variables drawn independently from some known parametric distribution. We leverage information-theoretic quantities, such as entropy and mutual information, to quantify the level of informativeness and rigorously characterize the amount of information contained in any subset of the complete collection of order statistics. As an example, we show how these informativeness metrics can be evaluated for a sample of discrete Bernoulli and continuous Uniform random variables. Finally, we unveil how our most informative order statistics framework can be applied to image processing applications. Specifically, we investigate how the proposed measures can be used to choose the coefficients of the L-estimator filter to denoise an image corrupted by random noise. We show that both for discrete (e.g., salt-pepper noise) and continuous (e.g., mixed Gaussian noise) noise distributions, the proposed method is competitive with off-the-shelf filters, such as the median and the total variation filters, as well as with wavelet-based denoising methods.

READ FULL TEXT

page 6

page 8

page 9

page 10

research
06/30/2019

Estimating Information-Theoretic Quantities with Random Forests

Information-theoretic quantities, such as mutual information and conditi...
research
09/25/2020

Measuring Dependencies of Order Statistics: An Information Theoretic Perspective

Consider a random sample X_1 , X_2 , ..., X_n drawn independently and id...
research
11/07/2015

Information Extraction Under Privacy Constraints

A privacy-constrained information extraction problem is considered where...
research
07/20/2018

Information Estimation Using Non-Parametric Copulas

Estimation of mutual information between random variables has become cru...
research
05/19/2019

Minimal Achievable Sufficient Statistic Learning

We introduce Minimal Achievable Sufficient Statistic (MASS) Learning, a ...
research
11/27/2010

Edge Preserving Image Denoising in Reproducing Kernel Hilbert Spaces

The goal of this paper is the development of a novel approach for the pr...
research
01/26/2021

On the distributions of some statistics related to adaptive filters trained with t-distributed samples

In this paper we analyse the behaviour of adaptive filters or detectors ...

Please sign up or login with your details

Forgot password? Click here to reset