A Versatile Approach to Evaluating and Testing Automated Vehicles based on Kernel Methods

10/01/2017
by   Zhiyuan Huang, et al.
0

Evaluation and validation of complicated control systems are crucial to guarantee usability and safety. Usually, failure happens in some very rarely encountered situations, but once triggered, the consequence is disastrous. Accelerated Evaluation is a methodology that efficiently tests those rarely-occurring yet critical failures via smartly-sampled test cases. The distribution used in sampling is pivotal to the performance of the method, but building a suitable distribution requires case-by-case analysis. This paper proposes a versatile approach for constructing sampling distribution using kernel method. The approach uses statistical learning tools to approximate the critical event sets and constructs distributions based on the unique properties of Gaussian distributions. We applied the method to evaluate the automated vehicles. Numerical experiments show proposed approach can robustly identify the rare failures and significantly reduce the evaluation time.

READ FULL TEXT

page 3

page 4

page 5

page 6

research
03/04/2020

Efficient statistical validation with edge cases to evaluate Highly Automated Vehicles

The widescale deployment of Autonomous Vehicles (AV) seems to be imminen...
research
05/28/2019

Rare Failure Prediction via Event Matching for Aerospace Applications

In this paper, we consider a problem of failure prediction in the contex...
research
04/01/2023

Adaptive Failure Search Using Critical States from Domain Experts

Uncovering potential failure cases is a crucial step in the validation o...
research
12/04/2018

Rigorous Agent Evaluation: An Adversarial Approach to Uncover Catastrophic Failures

This paper addresses the problem of evaluating learning systems in safet...
research
05/22/2019

A Method for Classifying Test Bench Configurations in a Scenario-Based Test Approach for Automated Vehicles

The introduction of automated vehicles demands a way to prove their safe...
research
07/10/2016

Accelerated Evaluation of Automated Vehicles in Car-Following Maneuvers

The safety of Automated Vehicles (AVs) must be assured before their rele...
research
02/23/2021

An Interaction-aware Evaluation Method for Highly Automated Vehicles

It is important to build a rigorous verification and validation (V V) ...

Please sign up or login with your details

Forgot password? Click here to reset