Off-the-shelf deep learning is not enough: parsimony, Bayes and causality

05/04/2020
by   Rama K. Vasudevan, et al.
0

Deep neural networks ("deep learning") have emerged as a technology of choice to tackle problems in natural language processing, computer vision, speech recognition and gameplay, and in just a few years has led to superhuman level performance and ushered in a new wave of "AI." Buoyed by these successes, researchers in the physical sciences have made steady progress in incorporating deep learning into their respective domains. However, such adoption brings substantial challenges that need to be recognized and confronted. Here, we discuss both opportunities and roadblocks to implementation of deep learning within materials science, focusing on the relationship between correlative nature of machine learning and causal hypothesis driven nature of physical sciences. We argue that deep learning and AI are now well positioned to revolutionize fields where causal links are known, as is the case for applications in theory. When confounding factors are frozen or change only weakly, this leaves open the pathway for effective deep learning solutions in experimental domains. Similarly, these methods offer a pathway towards understanding the physics of real-world systems, either via deriving reduced representations, deducing algorithmic complexity, or recovering generative physical models. However, extending deep learning and "AI" for models with unclear causal relationship can produce misleading and potentially incorrect results. Here, we argue the broad adoption of Bayesian methods incorporating prior knowledge, development of DL solutions with incorporated physical constraints, and ultimately adoption of causal models, offers a path forward for fundamental and applied research. Most notably, while these advances can change the way science is carried out in ways we cannot imagine, machine learning is not going to substitute science any time soon.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 4

page 8

09/03/2020

Deep Learning in Science

Much of the recent success of Artificial Intelligence (AI) has been spur...
05/13/2020

Deep Learning for Political Science

Political science, and social science in general, have traditionally bee...
12/20/2017

Contemporary machine learning: a guide for practitioners in the physical sciences

Machine learning is finding increasingly broad application in the physic...
08/28/2019

A Possible Reason for why Data-Driven Beats Theory-Driven Computer Vision

Why do some continue to wonder about the success and dominance of deep l...
03/13/2018

Using Convolutional Neural Networks for Determining Reticulocyte Percentage in Cats

Recent advances in artificial intelligence (AI), specifically in compute...
12/11/2020

Next Wave Artificial Intelligence: Robust, Explainable, Adaptable, Ethical, and Accountable

The history of AI has included several "waves" of ideas. The first wave,...
04/14/2020

RoboTHOR: An Open Simulation-to-Real Embodied AI Platform

Visual recognition ecosystems (e.g. ImageNet, Pascal, COCO) have undenia...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.