Novelty Detection and Analysis of Traffic Scenario Infrastructures in the Latent Space of a Vision Transformer-Based Triplet Autoencoder

05/05/2021
by   Jonas Wurst, et al.
1

Detecting unknown and untested scenarios is crucial for scenario-based testing. Scenario-based testing is considered to be a possible approach to validate autonomous vehicles. A traffic scenario consists of multiple components, with infrastructure being one of it. In this work, a method to detect novel traffic scenarios based on their infrastructure images is presented. An autoencoder triplet network provides latent representations for infrastructure images which are used for outlier detection. The triplet training of the network is based on the connectivity graphs of the infrastructure. By using the proposed architecture, expert-knowledge is used to shape the latent space such that it incorporates a pre-defined similarity in the neighborhood relationships of an autoencoder. An ablation study on the architecture is highlighting the importance of the triplet autoencoder combination. The best performing architecture is based on vision transformers, a convolution-free attention-based network. The presented method outperforms other state-of-the-art outlier detection approaches.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 3

page 7

05/27/2020

An Entropy Based Outlier Score and its Application to Novelty Detection for Road Infrastructure Images

A novel unsupervised outlier score, which can be embedded into graph bas...
05/21/2021

Joint Triplet Autoencoder for Histopathological Colon Cancer Nuclei Retrieval

Deep learning has shown a great improvement in the performance of visual...
10/05/2021

A Comparison of Neural Network Architectures for Data-Driven Reduced-Order Modeling

The popularity of deep convolutional autoencoders (CAEs) has engendered ...
07/11/2018

Sensor Networks Architecture for Vehicles and Pedestrians Traffic Control

In this paper we present a sensor network based architecture for urban t...
07/15/2020

Deep Representation Learning and Clustering of Traffic Scenarios

Determining the traffic scenario space is a major challenge for the homo...
11/11/2021

Improving Novelty Detection using the Reconstructions of Nearest Neighbours

We show that using nearest neighbours in the latent space of autoencoder...
10/28/2019

Accurate and Scalable Version Identification Using Musically-Motivated Embeddings

The version identification (VI) task deals with the automatic detection ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.