Explainable AI for System Failures: Generating Explanations that Improve Human Assistance in Fault Recovery

11/18/2020
by   Devleena Das, et al.
0

With the growing capabilities of intelligent systems, the integration of artificial intelligence (AI) and robots in everyday life is increasing. However, when interacting in such complex human environments, the failure of intelligent systems, such as robots, can be inevitable, requiring recovery assistance from users. In this work, we develop automated, natural language explanations for failures encountered during an AI agents' plan execution. These explanations are developed with a focus of helping non-expert users understand different point of failures to better provide recovery assistance. Specifically, we introduce a context-based information type for explanations that can both help non-expert users understand the underlying cause of a system failure, and select proper failure recoveries. Additionally, we extend an existing sequence-to-sequence methodology to automatically generate our context-based explanations. By doing so, we are able develop a model that can generalize context-based explanations over both different failure types and failure scenarios.

READ FULL TEXT

page 4

page 5

research
01/05/2021

Explainable AI for Robot Failures: Generating Explanations that Improve User Assistance in Fault Recovery

With the growing capabilities of intelligent systems, the integration of...
research
08/08/2021

Semantic-Based Explainable AI: Leveraging Semantic Scene Graphs and Pairwise Ranking to Explain Robot Failures

When interacting in unstructured human environments, occasional robot fa...
research
01/11/2022

Subgoal-Based Explanations for Unreliable Intelligent Decision Support Systems

Intelligent decision support (IDS) systems leverage artificial intellige...
research
07/07/2022

Evaluating Human-like Explanations for Robot Actions in Reinforcement Learning Scenarios

Explainable artificial intelligence is a research field that tries to pr...
research
04/26/2022

Process Knowledge-infused Learning for Suicidality Assessment on Social Media

Improving the performance and natural language explanations of deep lear...
research
04/27/2022

High-quality Conversational Systems

Conversational systems or chatbots are an example of AI-Infused Applicat...
research
03/02/2023

Compensating for Sensing Failures via Delegation in Human-AI Hybrid Systems

Given an increasing prevalence of intelligent systems capable of autonom...

Please sign up or login with your details

Forgot password? Click here to reset