Perceiving Humans: from Monocular 3D Localization to Social Distancing

09/01/2020
by   Lorenzo Bertoni, et al.
3

Perceiving humans in the context of Intelligent Transportation Systems (ITS) often relies on multiple cameras or expensive LiDAR sensors. In this work, we present a new cost-effective vision-based method that perceives humans' locations in 3D and their body orientation from a single image. We address the challenges related to the ill-posed monocular 3D tasks by proposing a deep learning method that predicts confidence intervals in contrast to point estimates. Our neural network architecture estimates humans 3D body locations and their orientation with a measure of uncertainty. Our vision-based system (i) is privacy-safe, (ii) works with any fixed or moving cameras, and (iii) does not rely on ground plane estimation. We demonstrate the performance of our method with respect to three applications: locating humans in 3D, detecting social interactions, and verifying the compliance of recent safety measures due to the COVID-19 outbreak. Indeed, we show that we can rethink the concept of "social distancing" as a form of social interaction in contrast to a simple location-based rule. We publicly share the source code towards an open science mission.

READ FULL TEXT

page 2

page 5

page 12

page 13

page 14

page 15

page 16

page 17

06/14/2019

MonoLoco: Monocular 3D Pedestrian Localization and Uncertainty Estimation

We tackle the fundamentally ill-posed problem of 3D human localization f...
04/21/2018

Monocular Vision-based Vehicle Localization Aided by Fine-grained Classification

Monocular camera systems are prevailing in intelligent transportation sy...
08/25/2020

MonStereo: When Monocular and Stereo Meet at the Tail of 3D Human Localization

Monocular and stereo vision are cost-effective solutions for 3D human lo...
06/27/2017

Topometric Localization with Deep Learning

Compared to LiDAR-based localization methods, which provide high accurac...
03/08/2019

Below Horizon Aircraft Detection Using Deep Learning for Vision-Based Sense and Avoid

Commercial operation of unmanned aerial vehicles (UAVs) would benefit fr...
07/07/2020

A Vision-based Social Distancing and Critical Density Detection System for COVID-19

Social distancing has been proven as an effective measure against the sp...
09/05/2017

SeDAR - Semantic Detection and Ranging: Humans can localise without LiDAR, can robots?

How does a person work out their location using a floorplan? It is proba...