Astronomia ex machina: a history, primer, and outlook on neural networks in astronomy

11/07/2022
by   Michael J. Smith, et al.
0

In recent years, deep learning has infiltrated every field it has touched, reducing the need for specialist knowledge and automating the process of knowledge discovery from data. This review argues that astronomy is no different, and that we are currently in the midst of a deep learning revolution that is transforming the way we do astronomy. We trace the history of astronomical connectionism from the early days of multilayer perceptrons, through the second wave of convolutional and recurrent neural networks, to the current third wave of self-supervised and unsupervised deep learning. We then predict that we will soon enter a fourth wave of astronomical connectionism, in which finetuned versions of an all-encompassing 'foundation' model will replace expertly crafted deep learning models. We argue that such a model can only be brought about through a symbiotic relationship between astronomy and connectionism, whereby astronomy provides high quality multimodal data to train the foundation model, and in turn the foundation model is used to advance astronomical research.

READ FULL TEXT

page 1

page 13

page 25

page 30

page 33

page 38

page 40

page 42

research
11/29/2022

Survey on Self-Supervised Multimodal Representation Learning and Foundation Models

Deep learning has been the subject of growing interest in recent years. ...
research
02/24/2017

On the Origin of Deep Learning

This paper is a review of the evolutionary history of deep learning mode...
research
12/17/2022

Foundation models in brief: A historical, socio-technical focus

Foundation models can be disruptive for future AI development by scaling...
research
04/30/2014

Deep Learning in Neural Networks: An Overview

In recent years, deep artificial neural networks (including recurrent on...
research
06/12/2019

Is Deep Learning an RG Flow?

Although there has been a rapid development of practical applications, t...
research
09/09/2022

Reconstruction of Three-dimensional Scroll Wave Chaos in Opaque and Transparent Excitable Media using Deep Neural Networks

Scroll wave chaos is thought to underlie life-threatening ventricular fi...

Please sign up or login with your details

Forgot password? Click here to reset