Safe Control Transitions: Machine Vision Based Observable Readiness Index and Data-Driven Takeover Time Prediction

01/14/2023
by   Ross Greer, et al.
1

To make safe transitions from autonomous to manual control, a vehicle must have a representation of the awareness of driver state; two metrics which quantify this state are the Observable Readiness Index and Takeover Time. In this work, we show that machine learning models which predict these two metrics are robust to multiple camera views, expanding from the limited view angles in prior research. Importantly, these models take as input feature vectors corresponding to hand location and activity as well as gaze location, and we explore the tradeoffs of different views in generating these feature vectors. Further, we introduce two metrics to evaluate the quality of control transitions following the takeover event (the maximal lateral deviation and velocity deviation) and compute correlations of these post-takeover metrics to the pre-takeover predictive metrics.

READ FULL TEXT

page 4

page 5

page 6

page 7

page 8

page 9

page 11

page 12

research
01/14/2023

(Safe) SMART Hands: Hand Activity Analysis and Distraction Alerts Using a Multi-Camera Framework

Manual (hand-related) activity is a significant source of crash risk whi...
research
11/14/2018

Looking at the Driver/Rider in Autonomous Vehicles to Predict Take-Over Readiness

Continuous estimation the driver's take-over readiness is critical for s...
research
04/23/2021

Autonomous Vehicles that Alert Humans to Take-Over Controls: Modeling with Real-World Data

With increasing automation in passenger vehicles, the study of safe and ...
research
07/27/2021

Predicting Take-over Time for Autonomous Driving with Real-World Data: Robust Data Augmentation, Models, and Evaluation

Understanding occupant-vehicle interactions by modeling control transiti...
research
08/18/2022

Steering Action-aware Adaptive Cruise Control for Teleoperated Driving

In this paper, a steering action-aware Adaptive Cruise Control (ACC) app...
research
04/17/2022

Synthetic Distracted Driving (SynDD1) dataset for analyzing distracted behaviors and various gaze zones of a driver

This article presents a synthetic distracted driving (SynDD1) dataset fo...
research
02/14/2015

Gray-Level Image Transitions Driven by Tsallis Entropic Index

The maximum entropy principle is largely used in thresholding and segmen...

Please sign up or login with your details

Forgot password? Click here to reset