DeepAI AI Chat
Log In Sign Up

Training Neural Networks for Likelihood/Density Ratio Estimation

by   George V. Moustakides, et al.

Various problems in Engineering and Statistics require the computation of the likelihood ratio function of two probability densities. In classical approaches the two densities are assumed known or to belong to some known parametric family. In a data-driven version we replace this requirement with the availability of data sampled from the densities of interest. For most well known problems in Detection and Hypothesis testing we develop solutions by providing neural network based estimates of the likelihood ratio or its transformations. This task necessitates the definition of proper optimizations which can be used for the training of the network. The main purpose of this work is to offer a simple and unified methodology for defining such optimization problems with guarantees that the solution is indeed the desired function. Our results are extended to cover estimates for likelihood ratios of conditional densities and estimates for statistics encountered in local approaches.


page 1

page 2

page 3

page 4


Nonparametric Likelihood Ratio Test for Univariate Shape-constrained Densities

We provide a comprehensive study of a nonparametric likelihood ratio tes...

Optimizing Shallow Networks for Binary Classification

Data driven classification that relies on neural networks is based on op...

Likelihood Asymptotics in Nonregular Settings: A Review with Emphasis on the Likelihood Ratio

This paper reviews the most common situations where one or more regulari...

Learning Optimal Test Statistics in the Presence of Nuisance Parameters

The design of optimal test statistics is a key task in frequentist stati...

Wald-Kernel: Learning to Aggregate Information for Sequential Inference

Sequential hypothesis testing is a desirable decision making strategy in...

Designing GANs: A Likelihood Ratio Approach

We are interested in the design of generative adversarial networks. The ...

Where to find needles in a haystack?

In many existing methods in multiple comparison, one starts with either ...