Formalizing and Evaluating Requirements of Perception Systems for Automated Vehicles using Spatio-Temporal Perception Logic

06/29/2022
by   Mohammad Hekmatnejad, et al.
0

Automated vehicles (AV) heavily depend on robust perception systems. Current methods for evaluating vision systems focus mainly on frame-by-frame performance. Such evaluation methods appear to be inadequate in assessing the performance of a perception subsystem when used within an AV. In this paper, we present a logic – referred to as Spatio-Temporal Perception Logic (STPL) – which utilizes both spatial and temporal modalities. STPL enables reasoning over perception data using spatial and temporal relations. One major advantage of STPL is that it facilitates basic sanity checks on the real-time performance of the perception system, even without ground-truth data in some cases. We identify a fragment of STPL which is efficiently monitorable offline in polynomial time. Finally, we present a range of specifications for AV perception systems to highlight the types of requirements that can be expressed and analyzed through offline monitoring with STPL.

READ FULL TEXT

page 1

page 2

page 9

page 12

page 14

page 16

page 17

page 23

research
04/15/2019

Monitoring Mobile and Spatially Distributed Cyber-Physical Systems

Cyber-Physical Systems (CPS) consist of collaborative, networked and tig...
research
07/22/2021

CogSense: A Cognitively Inspired Framework for Perception Adaptation

This paper proposes the CogSense system, which is inspired by sense-maki...
research
12/20/2021

Learning Spatio-Temporal Specifications for Dynamical Systems

Learning dynamical systems properties from data provides important insig...
research
07/29/2019

Seeing Things in Random-Dot Videos

The human visual system correctly groups features and interprets videos ...
research
04/11/2020

Trajectory annotation using sequences of spatial perception

In the near future, more and more machines will perform tasks in the vic...
research
10/12/2011

Combining Spatial and Temporal Logics: Expressiveness vs. Complexity

In this paper, we construct and investigate a hierarchy of spatio-tempor...
research
02/04/2022

Semi-Supervised Trajectory-Feedback Controller Synthesis for Signal Temporal Logic Specifications

There are spatio-temporal rules that dictate how robots should operate i...

Please sign up or login with your details

Forgot password? Click here to reset