Gradient-based explanations for Gaussian Process regression and classification models

05/25/2022
by   Sarem Seitz, et al.
0

Gaussian Processes (GPs) have proven themselves as a reliable and effective method in probabilistic Machine Learning. Thanks to recent and current advances, modeling complex data with GPs is becoming more and more feasible. Thus, these types of models are, nowadays, an interesting alternative to Neural and Deep Learning methods, which are arguably the current state-of-the-art in Machine Learning. For the latter, we see an increasing interest in so-called explainable approaches - in essence methods that aim to make a Machine Learning model's decision process transparent to humans. Such methods are particularly needed when illogical or biased reasoning can lead to actual disadvantageous consequences for humans. Ideally, explainable Machine Learning should help detect such flaws in a model and aid a subsequent debugging process. One active line of research in Machine Learning explainability are gradient-based methods, which have been successfully applied to complex neural networks. Given that GPs are closed under differentiation, gradient-based explainability for GPs appears as a promising field of research. This paper is primarily focused on explaining GP classifiers via gradients where, contrary to GP regression, derivative GPs are not straightforward to obtain.

READ FULL TEXT

page 11

page 12

02/15/2021

GP-Tree: A Gaussian Process Classifier for Few-Shot Incremental Learning

Gaussian processes (GPs) are non-parametric, flexible, models that work ...
07/23/2021

Robust Explainability: A Tutorial on Gradient-Based Attribution Methods for Deep Neural Networks

With the rise of deep neural networks, the challenge of explaining the p...
10/26/2021

Non-Gaussian Gaussian Processes for Few-Shot Regression

Gaussian Processes (GPs) have been widely used in machine learning to mo...
04/06/2021

Towards a Rigorous Evaluation of Explainability for Multivariate Time Series

Machine learning-based systems are rapidly gaining popularity and in-lin...
12/18/2021

GPEX, A Framework For Interpreting Artificial Neural Networks

Machine learning researchers have long noted a trade-off between interpr...
07/20/2022

Machine learning and geospatial methods for large-scale mining data

The canonical technique for nonlinear modeling of spatial and other poin...
08/26/2018

Ensemble Learning Applied to Classify GPS Trajectories of Birds into Male or Female

We describe our first-place solution to the Animal Behavior Challenge (A...