Do Pedestrians Pay Attention? Eye Contact Detection in the Wild

12/08/2021
by   Younes Belkada, et al.
15

In urban or crowded environments, humans rely on eye contact for fast and efficient communication with nearby people. Autonomous agents also need to detect eye contact to interact with pedestrians and safely navigate around them. In this paper, we focus on eye contact detection in the wild, i.e., real-world scenarios for autonomous vehicles with no control over the environment or the distance of pedestrians. We introduce a model that leverages semantic keypoints to detect eye contact and show that this high-level representation (i) achieves state-of-the-art results on the publicly-available dataset JAAD, and (ii) conveys better generalization properties than leveraging raw images in an end-to-end network. To study domain adaptation, we create LOOK: a large-scale dataset for eye contact detection in the wild, which focuses on diverse and unconstrained scenarios for real-world generalization. The source code and the LOOK dataset are publicly shared towards an open science mission.

READ FULL TEXT

page 1

page 3

page 7

page 9

page 10

research
06/04/2020

Autonomous Driving: Framework for Pedestrian Intention Estimationin a Real World Scenario

Rapid advancements in driver-assistance technology will lead to the inte...
research
03/29/2021

Onfocus Detection: Identifying Individual-Camera Eye Contact from Unconstrained Images

Onfocus detection aims at identifying whether the focus of the individua...
research
10/05/2022

Learning Video-independent Eye Contact Segmentation from In-the-Wild Videos

Human eye contact is a form of non-verbal communication and can have a g...
research
01/05/2021

Janus: Efficient and Accurate Dual-radio Social Contact Detection

Determining when two individuals are within close distance is key to con...
research
04/08/2019

Eye Contact Between Pedestrians and Drivers

When asked, a majority of people believe that, as pedestrians, they make...
research
07/25/2019

Accurate and Robust Eye Contact Detection During Everyday Mobile Device Interactions

Quantification of human attention is key to several tasks in mobile huma...
research
10/14/2022

Pishgu: Universal Path Prediction Architecture through Graph Isomorphism and Attentive Convolution

Path prediction is an essential task for several real-world real-time ap...

Please sign up or login with your details

Forgot password? Click here to reset