DeepAI AI Chat
Log In Sign Up

Towards a Rigorous Evaluation of Explainability for Multivariate Time Series

by   Rohit Saluja, et al.
Umeå universitet
KTH Royal Institute of Technology

Machine learning-based systems are rapidly gaining popularity and in-line with that there has been a huge research surge in the field of explainability to ensure that machine learning models are reliable, fair, and can be held liable for their decision-making process. Explainable Artificial Intelligence (XAI) methods are typically deployed to debug black-box machine learning models but in comparison to tabular, text, and image data, explainability in time series is still relatively unexplored. The aim of this study was to achieve and evaluate model agnostic explainability in a time series forecasting problem. This work focused on proving a solution for a digital consultancy company aiming to find a data-driven approach in order to understand the effect of their sales related activities on the sales deals closed. The solution involved framing the problem as a time series forecasting problem to predict the sales deals and the explainability was achieved using two novel model agnostic explainability techniques, Local explainable model-agnostic explanations (LIME) and Shapley additive explanations (SHAP) which were evaluated using human evaluation of explainability. The results clearly indicate that the explanations produced by LIME and SHAP greatly helped lay humans in understanding the predictions made by the machine learning model. The presented work can easily be extended to any time


page 1

page 2

page 3

page 4


TsSHAP: Robust model agnostic feature-based explainability for time series forecasting

A trustworthy machine learning model should be accurate as well as expla...

Explaining Hate Speech Classification with Model Agnostic Methods

There have been remarkable breakthroughs in Machine Learning and Artific...

A Data-driven Case-based Reasoning in Bankruptcy Prediction

There has been intensive research regarding machine learning models for ...

Does Dataset Complexity Matters for Model Explainers?

Strategies based on Explainable Artificial Intelligence - XAI have emerg...

Explainable Human-in-the-loop Dynamic Data-Driven Digital Twins

Digital Twins (DT) are essentially Dynamic Data-driven models that serve...

The Ability of Image-Language Explainable Models to Resemble Domain Expertise

Recent advances in vision and language (V+L) models have a promising imp...