Statistical model-based evaluation of neural networks

11/18/2020
by   Sandipan Das, et al.
0

Using a statistical model-based data generation, we develop an experimental setup for the evaluation of neural networks (NNs). The setup helps to benchmark a set of NNs vis-a-vis minimum-mean-square-error (MMSE) performance bounds. This allows us to test the effects of training data size, data dimension, data geometry, noise, and mismatch between training and testing conditions. In the proposed setup, we use a Gaussian mixture distribution to generate data for training and testing a set of competing NNs. Our experiments show the importance of understanding the type and statistical conditions of data for appropriate application and design of NNs

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/24/2020

Unsupervised neural adaptation model based on optimal transport for spoken language identification

Due to the mismatch of statistical distributions of acoustic speech betw...
research
03/25/2016

The Asymptotic Performance of Linear Echo State Neural Networks

In this article, a study of the mean-square error (MSE) performance of l...
research
04/05/2019

Robust Binaural Localization of a Target Sound Source by Combining Spectral Source Models and Deep Neural Networks

Despite there being clear evidence for top-down (e.g., attentional) effe...
research
02/02/2022

The CORAL++ Algorithm for Unsupervised Domain Adaptation of Speaker Recogntion

State-of-the-art speaker recognition systems are trained with a large am...
research
10/30/2019

Bounding Data-driven Model Errors in Power Grid Analysis

Data-driven models analyze power grids under incomplete physical informa...
research
02/12/2023

Deep Neural Networks for Nonparametric Interaction Models with Diverging Dimension

Deep neural networks have achieved tremendous success due to their repre...
research
03/13/2019

Uncertainty Aware Learning from Demonstrations in Multiple Contexts using Bayesian Neural Networks

Diversity of environments is a key challenge that causes learned robotic...

Please sign up or login with your details

Forgot password? Click here to reset