Towards urban scenes understanding through polarization cues

06/03/2021
by   Marc Blanchon, et al.
0

Autonomous robotics is critically affected by the robustness of its scene understanding algorithms. We propose a two-axis pipeline based on polarization indices to analyze dynamic urban scenes. As robots evolve in unknown environments, they are prone to encountering specular obstacles. Usually, specular phenomena are rarely taken into account by algorithms which causes misinterpretations and erroneous estimates. By exploiting all the light properties, systems can greatly increase their robustness to events. In addition to the conventional photometric characteristics, we propose to include polarization sensing. We demonstrate in this paper that the contribution of polarization measurement increases both the performances of segmentation and the quality of depth estimation. Our polarimetry-based approaches are compared here with other state-of-the-art RGB-centric methods showing interest of using polarization imaging.

READ FULL TEXT

page 5

page 9

page 11

page 12

page 14

research
07/15/2020

P2D: a self-supervised method for depth estimation from polarimetry

Monocular depth estimation is a recurring subject in the field of comput...
research
03/31/2021

Evaluation of Multimodal Semantic Segmentation using RGB-D Data

Our goal is to develop stable, accurate, and robust semantic scene under...
research
09/08/2021

Panoptic nuScenes: A Large-Scale Benchmark for LiDAR Panoptic Segmentation and Tracking

Panoptic scene understanding and tracking of dynamic agents are essentia...
research
10/06/2019

Joint Image and Depth Estimation with Mask-Based Lensless Cameras

Mask-based lensless cameras replace the lens of a conventional camera wi...
research
06/23/2023

Improving Panoptic Segmentation for Nighttime or Low-Illumination Urban Driving Scenes

Autonomous vehicles and driving systems use scene parsing as an essentia...
research
05/22/2020

Polarimetric image augmentation

Robotics applications in urban environments are subject to obstacles tha...

Please sign up or login with your details

Forgot password? Click here to reset