Property-Based Testing in Simulation for Verifying Robot Action Execution in Tabletop Manipulation

08/19/2021
by   Salman Omar Sohail, et al.
0

An important prerequisite for the reliability and robustness of a service robot is ensuring the robot's correct behavior when it performs various tasks of interest. Extensive testing is one established approach for ensuring behavioural correctness; this becomes even more important with the integration of learning-based methods into robot software architectures, as there are often no theoretical guarantees about the performance of such methods in varying scenarios. In this paper, we aim towards evaluating the correctness of robot behaviors in tabletop manipulation through automatic generation of simulated test scenarios in which a robot assesses its performance using property-based testing. In particular, key properties of interest for various robot actions are encoded in an action ontology and are then verified and validated within a simulated environment. We evaluate our framework with a Toyota Human Support Robot (HSR) which is tested in a Gazebo simulation. We show that our framework can correctly and consistently identify various failed actions in a variety of randomised tabletop manipulation scenarios, in addition to providing deeper insights into the type and location of failures for each designed property.

READ FULL TEXT

page 1

page 6

research
07/20/2021

Ontology-Assisted Generalisation of Robot Action Execution Knowledge

When an autonomous robot learns how to execute actions, it is of interes...
research
12/31/2012

Autonomously Learning to Visually Detect Where Manipulation Will Succeed

Visual features can help predict if a manipulation behavior will succeed...
research
03/23/2020

Linear Time-Varying MPC for Nonprehensile Object Manipulation with a Nonholonomic Mobile Robot

This paper proposes a technique to manipulate an object with a nonholono...
research
11/28/2022

CLAS: Coordinating Multi-Robot Manipulation with Central Latent Action Spaces

Multi-robot manipulation tasks involve various control entities that can...
research
05/08/2023

Multimodal Detection and Identification of Robot Manipulation Failures

An autonomous service robot should be able to interact with its environm...
research
02/11/2020

Human-to-Robot Attention Transfer for Robot Execution Failure Avoidance Using Stacked Neural Networks

Due to world dynamics and hardware uncertainty, robots inevitably fail i...
research
10/02/2021

OSCAR: Data-Driven Operational Space Control for Adaptive and Robust Robot Manipulation

Learning performant robot manipulation policies can be challenging due t...

Please sign up or login with your details

Forgot password? Click here to reset