A Causal-based Approach to Explain, Predict and Prevent Failures in Robotic Tasks

09/12/2022
by   Maximilian Diehl, et al.
0

Robots working in real environments need to adapt to unexpected changes to avoid failures. This is an open and complex challenge that requires robots to timely predict and identify the causes of failures to prevent them. In this paper, we present a causal method that will enable robots to predict when errors are likely to occur and prevent them from happening by executing a corrective action. First, we propose a causal-based method to detect the cause-effect relationships between task executions and their consequences by learning a causal Bayesian network (BN). The obtained model is transferred from simulated data to real scenarios to demonstrate the robustness and generalization of the obtained models. Based on the causal BN, the robot can predict if and why the executed action will succeed or not in its current state. Then, we introduce a novel method that finds the closest state alternatives through a contrastive Breadth-First-Search if the current action was predicted to fail. We evaluate our approach for the problem of stacking cubes in two cases; a) single stacks (stacking one cube) and; b) multiple stacks (stacking three cubes). In the single-stack case, our method was able to reduce the error rate by 97 capture multiple actions in one model, allowing to measure timely shifted action effects, such as the impact of an imprecise stack of the first cube on the stacking success of the third cube. For these complex situations, our model was able to prevent around 75 multiple-stack scenario. Thus, demonstrating that our method is able to explain, predict, and prevent execution failures, which even scales to complex scenarios that require an understanding of how the action history impacts future actions.

READ FULL TEXT

page 21

page 25

page 26

research
04/09/2022

Why did I fail? A Causal-based Method to Find Explanations for Robot Failures

Robot failures in human-centered environments are inevitable. Therefore,...
research
12/19/2018

Specializing Underdetermined Action Descriptions Through Plan Projection

Plan execution on real robots in realistic environments is underdetermin...
research
08/11/2023

Towards a Causal Probabilistic Framework for Prediction, Action-Selection Explanations for Robot Block-Stacking Tasks

Uncertainties in the real world mean that is impossible for system desig...
research
08/25/2022

PREVENT: An Unsupervised Approach to Predict Software Failures in Production

This paper presents PREVENT, an approach for predicting and localizing f...
research
02/08/2023

Asking for Help: Failure Prediction in Behavioral Cloning through Value Approximation

Recent progress in end-to-end Imitation Learning approaches has shown pr...
research
11/14/2017

Simulating Action Dynamics with Neural Process Networks

Understanding procedural language requires anticipating the causal effec...
research
01/24/2020

What went wrong?: Identification of Everyday Object Manipulation Anomalies

Extending the abilities of service robots is important for expanding wha...

Please sign up or login with your details

Forgot password? Click here to reset