Run-Time Monitoring of Machine Learning for Robotic Perception: A Survey of Emerging Trends

by   Quazi Marufur Rahman, et al.

As deep learning continues to dominate all state-of-the-art computer vision tasks, it is increasingly becoming the essential building blocks for robotic perception. As a result, the research questions concerning the safety and reliability of learning-based perception are gaining increased importance. Although there is an established field that studies safety certification and convergence guarantee of complex software systems for decision-making during design-time, the uncertainty in run-time conditions and the unknown future deployment environments of autonomous systems as well as the complexity of learning-based perception systems make the generalisation of the verification results from design-time to run-time problematic. More attention is starting to shift towards run-time monitoring of performance and reliability of perception systems with several trends emerging in the literature in the face of such a challenge. This paper attempts to identify these trends and summarise the various approaches on the topic.



There are no comments yet.


page 1

page 2

page 3

page 4


SOTER on ROS: A Run-Time Assurance Framework on the Robot Operating System

We present an implementation of SOTER, a run-time assurance framework fo...

Monitoring Robotic Systems using CSP: From Safety Designs to Safety Monitors

Runtime Verification (RV) involves monitoring a system to check if it sa...

On the Monitorability of Session Types, in Theory and Practice (Extended Version)

In concurrent and distributed systems, software components are expected ...

A stochastically verifiable autonomous control architecture with reasoning

A new agent architecture called Limited Instruction Set Agent (LISA) is ...

Run-time Performance Monitoring of Heterogenous Hw/Sw Platforms Using PAPI

In the era of Cyber Physical Systems, designers need to offer support fo...

RESCUE: Interdependent Challenges of Reliability, Security and Quality in Nanoelectronic Systems

The recent trends for nanoelectronic computing systems include machine-t...

A Survey of Machine Learning Applied to Computer Architecture Design

Machine learning has enabled significant benefits in diverse fields, but...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.