Looking at the Driver/Rider in Autonomous Vehicles to Predict Take-Over Readiness

11/14/2018
by   Nachiket Deo, et al.
0

Continuous estimation the driver's take-over readiness is critical for safe and timely transfer of control during the failure modes of autonomous vehicles. In this paper, we propose a data-driven approach for estimating the driver's take-over readiness based purely on observable cues from in-vehicle vision sensors. We present an extensive naturalistic drive dataset of drivers in a conditionally autonomous vehicle running on Californian freeways. We collect subjective ratings for the driver's take-over readiness from multiple human observers viewing the sensor feed. Analysis of the ratings in terms of intra-class correlation coefficients (ICCs) shows a high degree of consistency in the ratings across raters. We define a metric for the driver's take-over readiness termed the 'Observable Readiness Index (ORI)' based on the ratings. Finally, we propose an LSTM model for continuous estimation of the driver's ORI based on a holistic representation of the driver's state, capturing gaze, hand, pose and foot activity. Our model estimates the ORI with a mean absolute error of 0.449 on a 5 point scale.

READ FULL TEXT

page 2

page 3

page 4

page 6

page 9

research
03/02/2018

Identifying Driver Behaviors using Trajectory Features for Vehicle Navigation

We present a novel approach to automatically identify driver behaviors f...
research
04/23/2021

Autonomous Vehicles that Alert Humans to Take-Over Controls: Modeling with Real-World Data

With increasing automation in passenger vehicles, the study of safe and ...
research
07/11/2016

A Framework for Estimating Long Term Driver Behavior

The authors present a cyber-physical systems study on the estimation of ...
research
01/14/2023

Safe Control Transitions: Machine Vision Based Observable Readiness Index and Data-Driven Takeover Time Prediction

To make safe transitions from autonomous to manual control, a vehicle mu...
research
02/20/2022

How might Driver Licensing and Vehicle Registration evolve if we adopt Autonomous Cars and Digital Identification?

It has been said that fewer or greater numbers of driver's licenses may ...
research
04/20/2018

HandyNet: A One-stop Solution to Detect, Segment, Localize & Analyze Driver Hands

Tasks related to human hands have long been part of the computer vision ...
research
01/14/2023

(Safe) SMART Hands: Hand Activity Analysis and Distraction Alerts Using a Multi-Camera Framework

Manual (hand-related) activity is a significant source of crash risk whi...

Please sign up or login with your details

Forgot password? Click here to reset