DeepAI AI Chat
Log In Sign Up

Test-time Adaptation vs. Training-time Generalization: A Case Study in Human Instance Segmentation using Keypoints Estimation

12/12/2022
by   Kambiz Azarian, et al.
Qualcomm
0

We consider the problem of improving the human instance segmentation mask quality for a given test image using keypoints estimation. We compare two alternative approaches. The first approach is a test-time adaptation (TTA) method, where we allow test-time modification of the segmentation network's weights using a single unlabeled test image. In this approach, we do not assume test-time access to the labeled source dataset. More specifically, our TTA method consists of using the keypoints estimates as pseudo labels and backpropagating them to adjust the backbone weights. The second approach is a training-time generalization (TTG) method, where we permit offline access to the labeled source dataset but not the test-time modification of weights. Furthermore, we do not assume the availability of any images from or knowledge about the target domain. Our TTG method consists of augmenting the backbone features with those generated by the keypoints head and feeding the aggregate vector to the mask head. Through a comprehensive set of ablations, we evaluate both approaches and identify several factors limiting the TTA gains. In particular, we show that in the absence of a significant domain shift, TTA may hurt and TTG show only a small gain in performance, whereas for a large domain shift, TTA gains are smaller and dependent on the heuristics used, while TTG gains are larger and robust to architectural choices.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 8

12/04/2021

Unsupervised Adaptation of Semantic Segmentation Models without Source Data

We consider the novel problem of unsupervised domain adaptation of sourc...
12/04/2021

SITA: Single Image Test-time Adaptation

In Test-time Adaptation (TTA), given a model trained on some source data...
03/30/2022

Learning Instance-Specific Adaptation for Cross-Domain Segmentation

We propose a test-time adaptation method for cross-domain image segmenta...
03/07/2023

Guiding Pseudo-labels with Uncertainty Estimation for Test-Time Adaptation

Standard Unsupervised Domain Adaptation (UDA) methods assume the availab...
04/21/2022

Unseen Object Instance Segmentation with Fully Test-time RGB-D Embeddings Adaptation

Segmenting unseen objects is a crucial ability for the robot since it ma...
12/16/2022

CD-TTA: Compound Domain Test-time Adaptation for Semantic Segmentation

Test-time adaptation (TTA) has attracted significant attention due to it...
07/13/2020

Robustness to Spurious Correlations via Human Annotations

The reliability of machine learning systems critically assumes that the ...