Evaluation of Local Explanation Methods for Multivariate Time Series Forecasting

09/18/2020
by   Ozan Ozyegen, et al.
12

Being able to interpret a machine learning model is a crucial task in many applications of machine learning. Specifically, local interpretability is important in determining why a model makes particular predictions. Despite the recent focus on AI interpretability, there has been a lack of research in local interpretability methods for time series forecasting while the few interpretable methods that exist mainly focus on time series classification tasks. In this study, we propose two novel evaluation metrics for time series forecasting: Area Over the Perturbation Curve for Regression and Ablation Percentage Threshold. These two metrics can measure the local fidelity of local explanation models. We extend the theoretical foundation to collect experimental results on two popular datasets, Rossmann sales and electricity. Both metrics enable a comprehensive comparison of numerous local explanation models and find which metrics are more sensitive. Lastly, we provide heuristical reasoning for this analysis.

READ FULL TEXT

page 1

page 2

research
09/17/2021

TS-MULE: Local Interpretable Model-Agnostic Explanations for Time Series Forecast Models

Time series forecasting is a demanding task ranging from weather to fail...
research
02/11/2022

InterpretTime: a new approach for the systematic evaluation of neural-network interpretability in time series classification

We present a novel approach to evaluate the performance of interpretabil...
research
09/09/2018

Performance Metrics (Error Measures) in Machine Learning Regression, Forecasting and Prognostics: Properties and Typology

Performance metrics (error measures) are vital components of the evaluat...
research
05/18/2022

The Solvability of Interpretability Evaluation Metrics

Feature attribution methods are popular for explaining neural network pr...
research
10/10/2022

Self-explaining Hierarchical Model for Intraoperative Time Series

Major postoperative complications are devastating to surgical patients. ...
research
07/02/2021

Visual Time Series Forecasting: An Image-driven Approach

In this work, we address time-series forecasting as a computer vision ta...
research
12/07/2022

Truthful Meta-Explanations for Local Interpretability of Machine Learning Models

Automated Machine Learning-based systems' integration into a wide range ...

Please sign up or login with your details

Forgot password? Click here to reset