Towards a Mathematical Understanding of Neural Network-Based Machine Learning: what we know and what we don't

09/22/2020
by   Weinan E, et al.
270

The purpose of this article is to review the achievements made in the last few years towards the understanding of the reasons behind the success and subtleties of neural network-based machine learning. In the tradition of good old applied mathematics, we will not only give attention to rigorous mathematical results, but also the insight we have gained from careful numerical experiments as well as the analysis of simplified models. Along the way, we also list the open problems which we believe to be the most important topics for further study. This is not a complete overview over this quickly moving field, but we hope to provide a perspective which may be helpful especially to new researchers in the area.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 36

09/23/2020

Machine Learning and Computational Mathematics

Neural network-based machine learning is capable of approximating functi...
01/30/2020

Recent development in kinetic theory of granular materials: analysis and numerical methods

Over the past decades, kinetic description of granular materials has rec...
04/21/2020

Neural forecasting: Introduction and literature overview

Neural network based forecasting methods have become ubiquitous in large...
01/15/2021

Machine-Learning Mathematical Structures

We review, for a general audience, a variety of recent experiments on ex...
12/13/2017

Mathematics of Deep Learning

Recently there has been a dramatic increase in the performance of recogn...
12/05/2019

Exploration of Neural Machine Translation in Autoformalization of Mathematics in Mizar

In this paper we share several experiments trying to automatically trans...
06/24/2020

Predicting First Passage Percolation Shapes Using Neural Networks

Many random growth models have the property that the set of discovered s...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.