Semantic Anomaly Detection with Large Language Models

by   Amine Elhafsi, et al.

As robots acquire increasingly sophisticated skills and see increasingly complex and varied environments, the threat of an edge case or anomalous failure is ever present. For example, Tesla cars have seen interesting failure modes ranging from autopilot disengagements due to inactive traffic lights carried by trucks to phantom braking caused by images of stop signs on roadside billboards. These system-level failures are not due to failures of any individual component of the autonomy stack but rather system-level deficiencies in semantic reasoning. Such edge cases, which we call semantic anomalies, are simple for a human to disentangle yet require insightful reasoning. To this end, we study the application of large language models (LLMs), endowed with broad contextual understanding and reasoning capabilities, to recognize these edge semantic cases. We introduce a monitoring framework for semantic anomaly detection in vision-based policies to do so. Our experiments evaluate this framework in monitoring a learned policy for object manipulation and a finite state machine policy for autonomous driving and demonstrate that an LLM-based monitor can serve as a proxy for human reasoning. Finally, we provide an extended discussion on the strengths and weaknesses of this approach and motivate a research outlook on how we can further use foundation models for semantic anomaly detection.


page 2

page 6

page 10

page 12

page 15

page 16


Synthetic outlier generation for anomaly detection in autonomous driving

Anomaly detection, or outlier detection, is a crucial task in various do...

syslrn: Learning What to Monitor for Efficient Anomaly Detection

While monitoring system behavior to detect anomalies and failures is imp...

Anomalous Motion Detection on Highway Using Deep Learning

Research in visual anomaly detection draws much interest due to its appl...

Context-Dependent Anomaly Detection with Knowledge Graph Embedding Models

Increasing the semantic understanding and contextual awareness of machin...

Synthesize then Compare: Detecting Failures and Anomalies for Semantic Segmentation

The ability to detect failures and anomalies are fundamental requirement...

Interpretable, Multidimensional, Multimodal Anomaly Detection with Negative Sampling for Detection of Device Failure

Complex devices are connected daily and eagerly generate vast streams of...

Please sign up or login with your details

Forgot password? Click here to reset