Perceiving Humans: from Monocular 3D Localization to Social Distancing

by   Lorenzo Bertoni, et al.

Perceiving humans in the context of Intelligent Transportation Systems (ITS) often relies on multiple cameras or expensive LiDAR sensors. In this work, we present a new cost-effective vision-based method that perceives humans' locations in 3D and their body orientation from a single image. We address the challenges related to the ill-posed monocular 3D tasks by proposing a deep learning method that predicts confidence intervals in contrast to point estimates. Our neural network architecture estimates humans 3D body locations and their orientation with a measure of uncertainty. Our vision-based system (i) is privacy-safe, (ii) works with any fixed or moving cameras, and (iii) does not rely on ground plane estimation. We demonstrate the performance of our method with respect to three applications: locating humans in 3D, detecting social interactions, and verifying the compliance of recent safety measures due to the COVID-19 outbreak. Indeed, we show that we can rethink the concept of "social distancing" as a form of social interaction in contrast to a simple location-based rule. We publicly share the source code towards an open science mission.


page 2

page 5

page 12

page 13

page 14

page 15

page 16

page 17


MonoLoco: Monocular 3D Pedestrian Localization and Uncertainty Estimation

We tackle the fundamentally ill-posed problem of 3D human localization f...

Monocular Vision-based Vehicle Localization Aided by Fine-grained Classification

Monocular camera systems are prevailing in intelligent transportation sy...

MonStereo: When Monocular and Stereo Meet at the Tail of 3D Human Localization

Monocular and stereo vision are cost-effective solutions for 3D human lo...

Topometric Localization with Deep Learning

Compared to LiDAR-based localization methods, which provide high accurac...

Below Horizon Aircraft Detection Using Deep Learning for Vision-Based Sense and Avoid

Commercial operation of unmanned aerial vehicles (UAVs) would benefit fr...

A Vision-based Social Distancing and Critical Density Detection System for COVID-19

Social distancing has been proven as an effective measure against the sp...

SeDAR - Semantic Detection and Ranging: Humans can localise without LiDAR, can robots?

How does a person work out their location using a floorplan? It is proba...