Visual Attention for Behavioral Cloning in Autonomous Driving

12/05/2018
by   Sourav Pal, et al.
12

The goal of our work is to use visual attention to enhance autonomous driving performance. We present two methods of predicting visual attention maps. The first method is a supervised learning approach in which we collect eye-gaze data for the task of driving and use this to train a model for predicting the attention map. The second method is a novel unsupervised approach where we train a model to learn to predict attention as it learns to drive a car. Finally, we present a comparative study of our results and show that the supervised approach for predicting attention when incorporated performs better than other approaches.

READ FULL TEXT

page 2

page 3

page 9

page 10

research
09/11/2019

Human Visual Attention Prediction Boosts Learning & Performance of Autonomous Driving Agents

Autonomous driving is a multi-task problem requiring a deep understandin...
research
05/16/2022

Bridging Sim2Real Gap Using Image Gradients for the Task of End-to-End Autonomous Driving

We present the first prize solution to NeurIPS 2021 - AWS Deepracer Chal...
research
05/01/2015

DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving

Today, there are two major paradigms for vision-based autonomous driving...
research
02/10/2015

Show, Attend and Tell: Neural Image Caption Generation with Visual Attention

Inspired by recent work in machine translation and object detection, we ...
research
02/06/2021

Predicting Eye Fixations Under Distortion Using Bayesian Observers

Visual attention is very an essential factor that affects how human perc...
research
10/23/2019

Winning the ICCV 2019 Learning to Drive Challenge

Autonomous driving has a significant impact on society. Predicting vehic...
research
07/20/2022

Visual Knowledge Tracing

Each year, thousands of people learn new visual categorization tasks – r...

Please sign up or login with your details

Forgot password? Click here to reset