A meta-algorithm for classification using random recursive tree ensembles: A high energy physics application

01/19/2020
by   Vidhi Lalchand, et al.
0

The aim of this work is to propose a meta-algorithm for automatic classification in the presence of discrete binary classes. Classifier learning in the presence of overlapping class distributions is a challenging problem in machine learning. Overlapping classes are described by the presence of ambiguous areas in the feature space with a high density of points belonging to both classes. This often occurs in real-world datasets, one such example is numeric data denoting properties of particle decays derived from high-energy accelerators like the Large Hadron Collider (LHC). A significant body of research targeting the class overlap problem use ensemble classifiers to boost the performance of algorithms by using them iteratively in multiple stages or using multiple copies of the same model on different subsets of the input training data. The former is called boosting and the latter is called bagging. The algorithm proposed in this thesis targets a challenging classification problem in high energy physics - that of improving the statistical significance of the Higgs discovery. The underlying dataset used to train the algorithm is experimental data built from the official ATLAS full-detector simulation with Higgs events (signal) mixed with different background events (background) that closely mimic the statistical properties of the signal generating class overlap. The algorithm proposed is a variant of the classical boosted decision tree which is known to be one of the most successful analysis techniques in experimental physics. The algorithm utilizes a unified framework that combines two meta-learning techniques - bagging and boosting. The results show that this combination only works in the presence of a randomization trick in the base learners.

READ FULL TEXT
research
01/16/2020

Extracting more from boosted decision trees: A high energy physics case study

Particle identification is one of the core tasks in the data analysis pi...
research
11/01/2018

META-DES.Oracle: Meta-learning and feature selection for ensemble selection

The key issue in Dynamic Ensemble Selection (DES) is defining a suitable...
research
08/09/2017

Classification without labels: Learning from mixed samples in high energy physics

Modern machine learning techniques can be used to construct powerful mod...
research
03/04/2021

Decision tree-based estimation of the overlap of two probability distributions

A new nonparametric approach, based on a decision tree algorithm, is pro...
research
12/17/2019

Embedded Constrained Feature Construction for High-Energy Physics Data Classification

Before any publication, data analysis of high-energy physics experiments...
research
06/05/2017

Progressive Boosting for Class Imbalance

Pattern recognition applications often suffer from skewed data distribut...
research
08/24/2020

Jet Flavour Classification Using DeepJet

Jet flavour classification is of paramount importance for a broad range ...

Please sign up or login with your details

Forgot password? Click here to reset