Enhancing accuracy of deep learning algorithms by training with low-discrepancy sequences

05/26/2020
by   Siddhartha Mishra, et al.
0

We propose a deep supervised learning algorithm based on low-discrepancy sequences as the training set. By a combination of theoretical arguments and extensive numerical experiments we demonstrate that the proposed algorithm significantly outperforms standard deep learning algorithms that are based on randomly chosen training data, for problems in moderately high dimensions. The proposed algorithm provides an efficient method for building inexpensive surrogates for many underlying maps in the context of scientific computing.

READ FULL TEXT
research
09/20/2019

A Multi-level procedure for enhancing accuracy of machine learning algorithms

We propose a multi-level method to increase the accuracy of machine lear...
research
11/19/2020

On tuning deep learning models: a data mining perspective

Deep learning algorithms vary depending on the underlying connection mec...
research
06/30/2020

Sliced Kernelized Stein Discrepancy

Kernelized Stein discrepancy (KSD), though being extensively used in goo...
research
12/13/2013

An Extensive Evaluation of Filtering Misclassified Instances in Supervised Classification Tasks

Removing or filtering outliers and mislabeled instances prior to trainin...
research
09/30/2020

First-order Optimization for Superquantile-based Supervised Learning

Classical supervised learning via empirical risk (or negative log-likeli...
research
09/30/2019

Full error analysis for the training of deep neural networks

Deep learning algorithms have been applied very successfully in recent y...
research
04/26/2019

A Deep-Learning Algorithm for Thyroid Malignancy Prediction From Whole Slide Cytopathology Images

We consider thyroid-malignancy prediction from ultra-high-resolution who...

Please sign up or login with your details

Forgot password? Click here to reset