Rethinking Ensemble-Distillation for Semantic Segmentation Based Unsupervised Domain Adaptation

04/29/2021
by   Chen-Hao Chao, et al.
0

Recent researches on unsupervised domain adaptation (UDA) have demonstrated that end-to-end ensemble learning frameworks serve as a compelling option for UDA tasks. Nevertheless, these end-to-end ensemble learning methods often lack flexibility as any modification to the ensemble requires retraining of their frameworks. To address this problem, we propose a flexible ensemble-distillation framework for performing semantic segmentation based UDA, allowing any arbitrary composition of the members in the ensemble while still maintaining its superior performance. To achieve such flexibility, our framework is designed to be robust against the output inconsistency and the performance variation of the members within the ensemble. To examine the effectiveness and the robustness of our method, we perform an extensive set of experiments on both GTA5 to Cityscapes and SYNTHIA to Cityscapes benchmarks to quantitatively inspect the improvements achievable by our method. We further provide detailed analyses to validate that our design choices are practical and beneficial. The experimental evidence validates that the proposed method indeed offer superior performance, robustness and flexibility in semantic segmentation based UDA tasks against contemporary baseline methods.

READ FULL TEXT

page 8

page 22

research
11/16/2022

ELDA: Using Edges to Have an Edge on Semantic Segmentation Based UDA

Many unsupervised domain adaptation (UDA) methods have been proposed to ...
research
04/10/2020

Phase Consistent Ecological Domain Adaptation

We introduce two criteria to regularize the optimization involved in lea...
research
08/16/2021

Multi-Target Adversarial Frameworks for Domain Adaptation in Semantic Segmentation

In this work, we address the task of unsupervised domain adaptation (UDA...
research
10/06/2021

Shallow Features Guide Unsupervised Domain Adaptation for Semantic Segmentation at Class Boundaries

Although deep neural networks have achieved remarkable results for the t...
research
04/01/2019

Significance-aware Information Bottleneck for Domain Adaptive Semantic Segmentation

For unsupervised domain adaptation problems, the strategy of aligning th...
research
11/25/2020

Unsupervised Domain Adaptation in Semantic Segmentation via Orthogonal and Clustered Embeddings

Deep learning frameworks allowed for a remarkable advancement in semanti...
research
11/15/2022

Instance-aware Model Ensemble With Distillation For Unsupervised Domain Adaptation

The linear ensemble based strategy, i.e., averaging ensemble, has been p...

Please sign up or login with your details

Forgot password? Click here to reset