Real-Time Face Eye Tracking and Blink Detection using Event Cameras

10/16/2020
by   Cian Ryan, et al.
0

Event cameras contain emerging, neuromorphic vision sensors that capture local light intensity changes at each pixel, generating a stream of asynchronous events. This way of acquiring visual information constitutes a departure from traditional frame based cameras and offers several significant advantages: low energy consumption, high temporal resolution, high dynamic range and low latency. Driver monitoring systems (DMS) are in-cabin safety systems designed to sense and understand a drivers physical and cognitive state. Event cameras are particularly suited to DMS due to their inherent advantages. This paper proposes a novel method to simultaneously detect and track faces and eyes for driver monitoring. A unique, fully convolutional recurrent neural network architecture is presented. To train this network, a synthetic event-based dataset is simulated with accurate bounding box annotations, called Neuromorphic HELEN. Additionally, a method to detect and analyse drivers eye blinks is proposed, exploiting the high temporal resolution of event cameras. Behaviour of blinking provides greater insights into a driver level of fatigue or drowsiness. We show that blinks have a unique temporal signature that can be better captured by event cameras.

READ FULL TEXT

page 6

page 11

page 12

page 13

page 14

page 16

page 17

research
08/15/2023

Neuromorphic Seatbelt State Detection for In-Cabin Monitoring with Event Cameras

Neuromorphic vision sensors, or event cameras, differ from conventional ...
research
03/27/2018

Event-based Dynamic Face Detection and Tracking Based on Activity

We present the first purely event-based approach for face detection usin...
research
08/22/2023

3ET: Efficient Event-based Eye Tracking using a Change-Based ConvLSTM Network

This paper presents a sparse Change-Based Convolutional Long Short-Term ...
research
05/04/2023

Neuromorphic Sensing for Yawn Detection in Driver Drowsiness

Driver monitoring systems (DMS) are a key component of vehicular safety ...
research
08/02/2022

Smart Visual Beacons with Asynchronous Optical Communications using Event Cameras

Event cameras are bio-inspired dynamic vision sensors that respond to ch...
research
07/25/2023

Decisive Data using Multi-Modality Optical Sensors for Advanced Vehicular Systems

Optical sensors have played a pivotal role in acquiring real world data ...
research
02/05/2018

Face recognition for monitoring operator shift in railways

Train Pilot is a very tedious and stressful job. Pilots must be vigilant...

Please sign up or login with your details

Forgot password? Click here to reset