TransAdapt: A Transformative Framework for Online Test Time Adaptive Semantic Segmentation

02/24/2023
by   Debasmit Das, et al.
0

Test-time adaptive (TTA) semantic segmentation adapts a source pre-trained image semantic segmentation model to unlabeled batches of target domain test images, different from real-world, where samples arrive one-by-one in an online fashion. To tackle online settings, we propose TransAdapt, a framework that uses transformer and input transformations to improve segmentation performance. Specifically, we pre-train a transformer-based module on a segmentation network that transforms unsupervised segmentation output to a more reliable supervised output, without requiring test-time online training. To also facilitate test-time adaptation, we propose an unsupervised loss based on the transformed input that enforces the model to be invariant and equivariant to photometric and geometric perturbations, respectively. Overall, our framework produces higher quality segmentation masks with up to 17.6 over no-adaptation and competitive baselines, respectively.

READ FULL TEXT

page 2

page 4

page 8

page 9

research
12/16/2022

CD-TTA: Compound Domain Test-time Adaptation for Semantic Segmentation

Test-time adaptation (TTA) has attracted significant attention due to it...
research
02/17/2015

Context Tricks for Cheap Semantic Segmentation

Accurate semantic labeling of image pixels is difficult because intra-cl...
research
08/10/2022

Semantic Self-adaptation: Enhancing Generalization with a Single Sample

Despite years of research, out-of-domain generalization remains a critic...
research
05/16/2023

Concurrent Misclassification and Out-of-Distribution Detection for Semantic Segmentation via Energy-Based Normalizing Flow

Recent semantic segmentation models accurately classify test-time exampl...
research
04/16/2019

Detecting the Unexpected via Image Resynthesis

Classical semantic segmentation methods, including the recent deep learn...
research
02/08/2022

Segmentation by Test-Time Optimization (TTO) for CBCT-based Adaptive Radiation Therapy

Online adaptive radiotherapy (ART) requires accurate and efficient auto-...

Please sign up or login with your details

Forgot password? Click here to reset