Off-the-shelf deep learning is not enough: parsimony, Bayes and causality

by   Rama K. Vasudevan, et al.

Deep neural networks ("deep learning") have emerged as a technology of choice to tackle problems in natural language processing, computer vision, speech recognition and gameplay, and in just a few years has led to superhuman level performance and ushered in a new wave of "AI." Buoyed by these successes, researchers in the physical sciences have made steady progress in incorporating deep learning into their respective domains. However, such adoption brings substantial challenges that need to be recognized and confronted. Here, we discuss both opportunities and roadblocks to implementation of deep learning within materials science, focusing on the relationship between correlative nature of machine learning and causal hypothesis driven nature of physical sciences. We argue that deep learning and AI are now well positioned to revolutionize fields where causal links are known, as is the case for applications in theory. When confounding factors are frozen or change only weakly, this leaves open the pathway for effective deep learning solutions in experimental domains. Similarly, these methods offer a pathway towards understanding the physics of real-world systems, either via deriving reduced representations, deducing algorithmic complexity, or recovering generative physical models. However, extending deep learning and "AI" for models with unclear causal relationship can produce misleading and potentially incorrect results. Here, we argue the broad adoption of Bayesian methods incorporating prior knowledge, development of DL solutions with incorporated physical constraints, and ultimately adoption of causal models, offers a path forward for fundamental and applied research. Most notably, while these advances can change the way science is carried out in ways we cannot imagine, machine learning is not going to substitute science any time soon.



There are no comments yet.


page 4

page 8


Deep Learning in Science

Much of the recent success of Artificial Intelligence (AI) has been spur...

Deep Learning for Political Science

Political science, and social science in general, have traditionally bee...

Contemporary machine learning: a guide for practitioners in the physical sciences

Machine learning is finding increasingly broad application in the physic...

A Possible Reason for why Data-Driven Beats Theory-Driven Computer Vision

Why do some continue to wonder about the success and dominance of deep l...

Using Convolutional Neural Networks for Determining Reticulocyte Percentage in Cats

Recent advances in artificial intelligence (AI), specifically in compute...

Next Wave Artificial Intelligence: Robust, Explainable, Adaptable, Ethical, and Accountable

The history of AI has included several "waves" of ideas. The first wave,...

RoboTHOR: An Open Simulation-to-Real Embodied AI Platform

Visual recognition ecosystems (e.g. ImageNet, Pascal, COCO) have undenia...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.