Semantic Understanding of Foggy Scenes with Purely Synthetic Data

10/09/2019
by   Martin Hahner, et al.
7

This work addresses the problem of semantic scene understanding under foggy road conditions. Although marked progress has been made in semantic scene understanding over the recent years, it is mainly concentrated on clear weather outdoor scenes. Extending semantic segmentation methods to adverse weather conditions like fog is crucially important for outdoor applications such as self-driving cars. In this paper, we propose a novel method, which uses purely synthetic data to improve the performance on unseen real-world foggy scenes captured in the streets of Zurich and its surroundings. Our results highlight the potential and power of photo-realistic synthetic images for training and especially fine-tuning deep neural nets. Our contributions are threefold, 1) we created a purely synthetic, high-quality foggy dataset of 25,000 unique outdoor scenes, that we call Foggy Synscapes and plan to release publicly 2) we show that with this data we outperform previous approaches on real-world foggy test data 3) we show that a combination of our data and previously used data can even further improve the performance on real-world foggy data.

READ FULL TEXT

page 3

page 4

page 5

page 7

research
01/05/2019

Curriculum Model Adaptation with Synthetic and Real Data for Semantic Foggy Scene Understanding

This work addresses the problem of semantic scene understanding under fo...
research
08/03/2018

Model Adaptation with Synthetic and Real Data for Semantic Dense Foggy Scene Understanding

This work addresses the problem of semantic scene understanding under de...
research
08/25/2017

Semantic Foggy Scene Understanding with Synthetic Data

This work addresses the problem of semantic foggy scene understanding (S...
research
04/20/2022

SELMA: SEmantic Large-scale Multimodal Acquisitions in Variable Weather, Daytime and Viewpoints

Accurate scene understanding from multiple sensors mounted on cars is a ...
research
10/30/2019

Multi Modal Semantic Segmentation using Synthetic Data

Semantic understanding of scenes in three-dimensional space (3D) is a qu...
research
09/25/2018

Scenic: Language-Based Scene Generation

Synthetic data has proved increasingly useful in both training and testi...
research
12/01/2021

Both Style and Fog Matter: Cumulative Domain Adaptation for Semantic Foggy Scene Understanding

Although considerable progress has been made in semantic scene understan...

Please sign up or login with your details

Forgot password? Click here to reset