Predicting decision-making in the future: Human versus Machine

10/09/2021
by   Hoe Sung Ryu, et al.
0

Deep neural networks (DNNs) have become remarkably successful in data prediction, and have even been used to predict future actions based on limited input. This raises the question: do these systems actually "understand" the event similar to humans? Here, we address this issue using videos taken from an accident situation in a driving simulation. In this situation, drivers had to choose between crashing into a suddenly-appeared obstacle or steering their car off a previously indicated cliff. We compared how well humans and a DNN predicted this decision as a function of time before the event. The DNN outperformed humans for early time-points, but had an equal performance for later time-points. Interestingly, spatio-temporal image manipulations and Grad-CAM visualizations uncovered some expected behavior, but also highlighted potential differences in temporal processing for the DNN.

READ FULL TEXT

page 4

page 9

page 10

research
10/10/2019

Misbehaviour Prediction for Autonomous Driving Systems

Deep Neural Networks (DNNs) are the core component of modern autonomous ...
research
01/12/2016

Deep Neural Networks predict Hierarchical Spatio-temporal Cortical Dynamics of Human Visual Object Recognition

The complex multi-stage architecture of cortical visual pathways provide...
research
03/03/2021

Self-Checking Deep Neural Networks in Deployment

The widespread adoption of Deep Neural Networks (DNNs) in important doma...
research
09/30/2018

Interactive Learning with Corrective Feedback for Policies based on Deep Neural Networks

Deep Reinforcement Learning (DRL) has become a powerful strategy to solv...
research
08/18/2020

XNAP: Making LSTM-based Next Activity Predictions Explainable by Using LRP

Predictive business process monitoring (PBPM) is a class of techniques d...
research
01/14/2021

Act to Reason: A Dynamic Game Theoretical Model of Driving

The focus of this paper is to propose a driver model that incorporates h...

Please sign up or login with your details

Forgot password? Click here to reset