Kalman Filter-based Heuristic Ensemble: A New Perspective on Ensemble Classification Using Kalman Filters

07/30/2018
by   Arjun Pakrashi, et al.
0

A classifier ensemble is a combination of multiple diverse classifier models whose outputs are aggregated into a single prediction. Ensembles have been repeatedly shown to perform better than single classifier models, therefore ensembles has been always a subject of research. The objective of this paper is to introduce a new perspective on ensemble classification by considering the training of the ensemble as a state estimation problem. The state is estimated using noisy measurements, and these measurements are then combined using a Kalman filter, within which heuristics are used. An implementation of this perspective, Kalman Filter based Heuristic Ensemble (KFHE), is also presented in this paper. Experiments performed on several datasets, indicate the effectiveness and the potential of KFHE when compared with boosting and bagging. Moreover, KFHE was found to perform comparatively better than bagging and boosting in the case of datasets with noisy class label assignments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/23/2019

KFHE-HOMER: Kalman Filter-based Heuristic Ensemble of HOMER for Multi-Label Classification

Multi-label classification allows a datapoint to be labelled with more t...
research
06/04/2020

A note on the formulation of the Ensemble Adjustment Kalman Filter

The ensemble adjustment Kalman filter (EAKF; Anderson, 2001) is one of t...
research
06/25/2023

Regularization of the ensemble Kalman filter using a non-stationary spatial convolution model

Applications of the ensemble Kalman filter to high-dimensional problems ...
research
08/04/2021

Investigating the Pilot Point Ensemble Kalman Filter for geostatistical inversion and data assimilation

Parameter estimation has a high importance in the geosciences. The ensem...
research
07/01/2020

A Multifidelity Ensemble Kalman Filter with Reduced Order Control Variates

This work develops a new multifidelity ensemble Kalman filter (MFEnKF) a...
research
08/19/2023

Enhancing State Estimation in Robots: A Data-Driven Approach with Differentiable Ensemble Kalman Filters

This paper introduces a novel state estimation framework for robots usin...
research
08/07/2023

GPU Optimization of Lattice Boltzmann Method with Local Ensemble Transform Kalman Filter

The ensemble data assimilation of computational fluid dynamics simulatio...

Please sign up or login with your details

Forgot password? Click here to reset