On the impact of modern deep-learning techniques to the performance and time-requirements of classification models in experimental high-energy physics

by   Giles Chatham Strong, et al.

Beginning from a basic neural-network architecture, we test the potential benefits offered by a range of advanced techniques for machine learning and deep learning in the context of a typical classification problem encountered in the domain of high-energy physics, using a well-studied dataset: the 2014 Higgs ML Kaggle dataset. The advantages are evaluated in terms of both performance metrics and the time required to train and apply the resulting models. Techniques examined include domain-specific data-augmentation, learning rate and momentum scheduling, (advanced) ensembling in both model-space and weight-space, and alternative architectures and connection methods. Following the investigation, we arrive at a model which achieves equal performance to the winning solution of the original Kaggle challenge, whilst requiring about 1 the training time and less than 5 specialised hardware. Additionally, a new wrapper library for PyTorch called LUMIN is presented, which incorporates all of the techniques studied.



There are no comments yet.


page 29

page 33


Deep Learning for Vertex Reconstruction of Neutrino-Nucleus Interaction Events with Combined Energy and Time Data

We present a deep learning approach for vertex reconstruction of neutrin...

Jet Flavour Classification Using DeepJet

Jet flavour classification is of paramount importance for a broad range ...

Efficient Deep Learning Architectures for Fast Identification of Bacterial Strains in Resource-Constrained Devices

This work presents twelve fine-tuned deep learning architectures to solv...

Hybrid Quantum-Classical Graph Convolutional Network

The high energy physics (HEP) community has a long history of dealing wi...

Learnergy: Energy-based Machine Learners

Throughout the last years, machine learning techniques have been broadly...

Acoustic scene classification using auditory datasets

The approach used not only challenges some of the fundamental mathematic...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.