Continual Conscious Active Fine-Tuning to Robustify Online Machine Learning Models Against Data Distribution Shifts

11/02/2022
by   Shawqi Al-Maliki, et al.
0

Unlike their offline traditional counterpart, online machine learning models are capable of handling data distribution shifts while serving at the test time. However, they have limitations in addressing this phenomenon. They are either expensive or unreliable. We propose augmenting an online learning approach called test-time adaptation with a continual conscious active fine-tuning layer to develop an enhanced variation that can handle drastic data distribution shifts reliably and cost-effectively. The proposed augmentation incorporates the following aspects: a continual aspect to confront the ever-ending data distribution shifts, a conscious aspect to imply that fine-tuning is a distribution-shift-aware process that occurs at the appropriate time to address the recently detected data distribution shifts, and an active aspect to indicate employing human-machine collaboration for the relabeling to be cost-effective and practical for diverse applications. Our empirical results show that the enhanced test-time adaptation variation outperforms the traditional variation by a factor of two.

READ FULL TEXT
research
09/19/2023

Test-Time Training for Speech

In this paper, we study the application of Test-Time Training (TTT) as a...
research
02/09/2023

Robust Question Answering against Distribution Shifts with Test-Time Adaptation: An Empirical Study

A deployed question answering (QA) model can easily fail when the test d...
research
03/02/2023

Learning to Adapt to Online Streams with Distribution Shifts

Test-time adaptation (TTA) is a technique used to reduce distribution ga...
research
06/06/2023

On Pitfalls of Test-Time Adaptation

Test-Time Adaptation (TTA) has recently emerged as a promising approach ...
research
11/23/2022

Robust Mean Teacher for Continual and Gradual Test-Time Adaptation

Since experiencing domain shifts during test-time is inevitable in pract...
research
06/08/2023

RDumb: A simple approach that questions our progress in continual test-time adaptation

Test-Time Adaptation (TTA) allows to update pretrained models to changin...
research
12/21/2020

Leaf Segmentation and Counting with Deep Learning: on Model Certainty, Test-Time Augmentation, Trade-Offs

Plant phenotyping tasks such as leaf segmentation and counting are funda...

Please sign up or login with your details

Forgot password? Click here to reset