A high-bias, low-variance introduction to Machine Learning for physicists

03/23/2018
by   Pankaj Mehta, et al.
2

Machine Learning (ML) is one of the most exciting and dynamic areas of modern research and application. The purpose of this review is to provide an introduction to the core concepts and tools of machine learning in a manner easily understood and intuitive to physicists. The review begins by covering fundamental concepts in ML and modern statistics such as the bias-variance tradeoff, overfitting, regularization, and generalization before moving on to more advanced topics in both supervised and unsupervised learning. Topics covered in the review include ensemble models, deep learning and neural networks, clustering and data visualization, energy-based models (including MaxEnt models and Restricted Boltzmann Machines), and variational methods. Throughout, we emphasize the many natural connections between ML and statistical physics. A notable aspect of the review is the use of Python notebooks to introduce modern ML/statistical packages to readers using physics-inspired datasets (the Ising Model and Monte-Carlo simulations of supersymmetric decays of proton-proton collisions). We conclude with an extended outlook discussing possible uses of machine learning for furthering our understanding of the physical world as well as open problems in ML where physicists maybe able to contribute. (Notebooks are available at https://physics.bu.edu/ pankajm/MLnotebooks.html )

READ FULL TEXT

page 7

page 8

page 9

page 24

page 26

page 29

page 32

page 33

research
06/17/2020

Introduction to Machine Learning for Accelerator Physics

This pair of CAS lectures gives an introduction for accelerator physics ...
research
11/12/2020

Utilizing Ensemble Learning for Performance and Power Modeling and Improvement of Parallel Cancer Deep Learning CANDLE Benchmarks

Machine learning (ML) continues to grow in importance across nearly all ...
research
05/28/2020

Machine Learning for Condensed Matter Physics

Condensed Matter Physics (CMP) seeks to understand the microscopic inter...
research
02/02/2021

A Living Review of Machine Learning for Particle Physics

Modern machine learning techniques, including deep learning, are rapidly...
research
08/09/2022

Sampling algorithms in statistical physics: a guide for statistics and machine learning

We discuss several algorithms for sampling from unnormalized probability...
research
07/20/2022

An Introduction to Modern Statistical Learning

This work in progress aims to provide a unified introduction to statisti...
research
12/23/2020

BENN: Bias Estimation Using Deep Neural Network

The need to detect bias in machine learning (ML) models has led to the d...

Please sign up or login with your details

Forgot password? Click here to reset