Test time Adaptation through Perturbation Robustness

10/19/2021
by   Prabhu Teja Sivaprasad, et al.
0

Data samples generated by several real world processes are dynamic in nature i.e., their characteristics vary with time. Thus it is not possible to train and tackle all possible distributional shifts between training and inference, using the host of transfer learning methods in literature. In this paper, we tackle this problem of adapting to domain shift at inference time i.e., we do not change the training process, but quickly adapt the model at test-time to handle any domain shift. For this, we propose to enforce consistency of predictions of data sampled in the vicinity of test sample on the image manifold. On a host of test scenarios like dealing with corruptions (CIFAR-10-C and CIFAR-100-C), and domain adaptation (VisDA-C), our method is at par or significantly outperforms previous methods.

READ FULL TEXT

page 10

page 12

page 13

research
08/16/2022

Gradual Test-Time Adaptation by Self-Training and Style Transfer

Domain shifts at test-time are inevitable in practice. Test-time adaptat...
research
09/27/2021

Training on Test Data with Bayesian Adaptation for Covariate Shift

When faced with distribution shift at test time, deep neural networks of...
research
09/18/2023

AR-TTA: A Simple Method for Real-World Continual Test-Time Adaptation

Test-time adaptation is a promising research direction that allows the s...
research
04/25/2023

Test-Time Adaptation with Perturbation Consistency Learning

Currently, pre-trained language models (PLMs) do not cope well with the ...
research
09/02/2023

pSTarC: Pseudo Source Guided Target Clustering for Fully Test-Time Adaptation

Test Time Adaptation (TTA) is a pivotal concept in machine learning, ena...
research
02/09/2022

Learning Robust Convolutional Neural Networks with Relevant Feature Focusing via Explanations

Existing image recognition techniques based on convolutional neural netw...
research
10/20/2022

TTTFlow: Unsupervised Test-Time Training with Normalizing Flow

A major problem of deep neural networks for image classification is thei...

Please sign up or login with your details

Forgot password? Click here to reset