DeepAI AI Chat
Log In Sign Up

Building BROOK: A Multi-modal and Facial Video Database for Human-Vehicle Interaction Research

05/18/2020
by   Xiangjun Peng, et al.
The University of Nottingham Ningbo China
26

With the growing popularity of Autonomous Vehicles, more opportunities have bloomed in the context of Human-Vehicle Interactions. However, the lack of comprehensive and concrete database support for such specific use case limits relevant studies in the whole design spaces. In this paper, we present our work-in-progress BROOK, a public multi-modal database with facial video records, which could be used to characterize drivers' affective states and driving styles. We first explain how we over-engineer such database in details, and what we have gained through a ten-month study. Then we showcase a Neural Network-based predictor, leveraging BROOK, which supports multi-modal prediction (including physiological data of heart rate and skin conductance and driving status data of speed)through facial videos. Finally, we discuss related issues when building such a database and our future directions in the context of BROOK. We believe BROOK is an essential building block for future Human-Vehicle Interaction Research.

READ FULL TEXT

page 1

page 3

page 4

page 5

02/14/2022

BROOK Dataset: A Playground for Exploiting Data-Driven Techniques in Human-Vehicle Interactive Designs

Emerging Autonomous Vehicles (AV) breed great potentials to exploit data...
11/11/2022

Multi-modal Fusion Technology based on Vehicle Information: A Survey

Multi-modal fusion is a basic task of autonomous driving system percepti...
04/25/2018

Multi-modal Approach for Affective Computing

Throughout the past decade, many studies have classified human emotions ...
03/01/2022

WEMAC: Women and Emotion Multi-modal Affective Computing dataset

Among the seventeen Sustainable Development Goals (SDGs) proposed within...
04/23/2019

Natural Language Interactions in Autonomous Vehicles: Intent Detection and Slot Filling from Passenger Utterances

Understanding passenger intents and extracting relevant slots are import...

Code Repositories

BROOK

Face-to-Multimodal Demonstration based on BROOK database


view repo