A Framework for Fast Prototyping of Photo-realistic Environments with Multiple Pedestrians

04/14/2023
by   Sara Casao, et al.
0

Robotic applications involving people often require advanced perception systems to better understand complex real-world scenarios. To address this challenge, photo-realistic and physics simulators are gaining popularity as a means of generating accurate data labeling and designing scenarios for evaluating generalization capabilities, e.g., lighting changes, camera movements or different weather conditions. We develop a photo-realistic framework built on Unreal Engine and AirSim to generate easily scenarios with pedestrians and mobile robots. The framework is capable to generate random and customized trajectories for each person and provides up to 50 ready-to-use people models along with an API for their metadata retrieval. We demonstrate the usefulness of the proposed framework with a use case of multi-target tracking, a popular problem in real pedestrian scenarios. The notable feature variability in the obtained perception data is presented and evaluated.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 6

research
10/15/2018

Pedestrian Dominance Modeling for Socially-Aware Robot Navigation

We present a Pedestrian Dominance Model (PDM) to identify the dominance ...
research
03/29/2021

High-fidelity Face Tracking for AR/VR via Deep Lighting Adaptation

3D video avatars can empower virtual communications by providing compres...
research
03/06/2017

All the people around me: face discovery in egocentric photo-streams

Given an unconstrained stream of images captured by a wearable photo-cam...
research
03/18/2017

Expecting the Unexpected: Training Detectors for Unusual Pedestrians with Adversarial Imposters

As autonomous vehicles become an every-day reality, high-accuracy pedest...
research
08/16/2020

Do Not Disturb Me: Person Re-identification Under the Interference of Other Pedestrians

In the conventional person Re-ID setting, it is widely assumed that crop...
research
10/06/2021

See Yourself in Others: Attending Multiple Tasks for Own Failure Detection

Autonomous robots deal with unexpected scenarios in real environments. G...

Please sign up or login with your details

Forgot password? Click here to reset