Model Based Explanations of Concept Drift

03/16/2023
by   Fabian Hinder, et al.
0

The notion of concept drift refers to the phenomenon that the distribution generating the observed data changes over time. If drift is present, machine learning models can become inaccurate and need adjustment. While there do exist methods to detect concept drift or to adjust models in the presence of observed drift, the question of explaining drift, i.e., describing the potentially complex and high dimensional change of distribution in a human-understandable fashion, has hardly been considered so far. This problem is of importance since it enables an inspection of the most prominent characteristics of how and where drift manifests itself. Hence, it enables human understanding of the change and it increases acceptance of life-long learning models. In this paper, we present a novel technology characterizing concept drift in terms of the characteristic change of spatial features based on various explanation techniques. To do so, we propose a methodology to reduce the explanation of concept drift to an explanation of models that are trained in a suitable way extracting relevant information regarding the drift. This way a large variety of explanation schemes is available. Thus, a suitable method can be selected for the problem of drift explanation at hand. We outline the potential of this approach and demonstrate its usefulness in several examples.

READ FULL TEXT

page 10

page 20

page 23

page 26

research
06/23/2020

Counterfactual Explanations of Concept Drift

The notion of concept drift refers to the phenomenon that the distributi...
research
12/02/2022

On the Change of Decision Boundaries and Loss in Learning with Concept Drift

The notion of concept drift refers to the phenomenon that the distributi...
research
06/24/2021

Meaningfully Explaining a Model's Mistakes

Understanding and explaining the mistakes made by trained models is crit...
research
09/06/2022

Change Detection for Local Explainability in Evolving Data Streams

As complex machine learning models are increasingly used in sensitive ap...
research
06/16/2020

Consistent Recalibration Models and Deep Calibration

Consistent Recalibration models (CRC) have been introduced to capture in...
research
12/04/2019

A probability theoretic approach to drifting data in continuous time domains

The notion of drift refers to the phenomenon that the distribution, whic...
research
12/12/2020

Concept Drift Monitoring and Diagnostics of Supervised Learning Models via Score Vectors

Supervised learning models are one of the most fundamental classes of mo...

Please sign up or login with your details

Forgot password? Click here to reset