Learning to adapt class-specific features across domains for semantic segmentation

01/22/2020
by   Mikel Menta, et al.
93

Recent advances in unsupervised domain adaptation have shown the effectiveness of adversarial training to adapt features across domains, endowing neural networks with the capability of being tested on a target domain without requiring any training annotations in this domain. The great majority of existing domain adaptation models rely on image translation networks, which often contain a huge amount of domain-specific parameters. Additionally, the feature adaptation step often happens globally, at a coarse level, hindering its applicability to tasks such as semantic segmentation, where details are of crucial importance to provide sharp results. In this thesis, we present a novel architecture, which learns to adapt features across domains by taking into account per class information. To that aim, we design a conditional pixel-wise discriminator network, whose output is conditioned on the segmentation masks. Moreover, following recent advances in image translation, we adopt the recently introduced StarGAN architecture as image translation backbone, since it is able to perform translations across multiple domains by means of a single generator network. Preliminary results on a segmentation task designed to assess the effectiveness of the proposed approach highlight the potential of the model, improving upon strong baselines and alternative designs.

READ FULL TEXT

page 5

page 6

page 7

page 8

page 10

page 11

page 15

page 16

research
08/13/2021

Dual Path Learning for Domain Adaptation of Semantic Segmentation

Domain adaptation for semantic segmentation enables to alleviate the nee...
research
12/01/2017

Image to Image Translation for Domain Adaptation

We propose a general framework for unsupervised domain adaptation, which...
research
09/05/2018

A Unified Feature Disentangler for Multi-Domain Image Translation and Manipulation

We present a novel and unified deep learning framework which is capable ...
research
02/15/2022

Beyond Deterministic Translation for Unsupervised Domain Adaptation

In this work we challenge the common approach of using a one-to-one mapp...
research
10/08/2021

Discover, Hallucinate, and Adapt: Open Compound Domain Adaptation for Semantic Segmentation

Unsupervised domain adaptation (UDA) for semantic segmentation has been ...
research
06/16/2020

Domain Adaptation with Morphologic Segmentation

We present a novel domain adaptation framework that uses morphologic seg...
research
01/16/2019

Conditional Domain Adaptation GANs for Biomedical Image Segmentation

Due to visual differences in biomedical image datasets acquired using di...

Please sign up or login with your details

Forgot password? Click here to reset