TempT: Temporal consistency for Test-time adaptation

03/19/2023
by   Onur Cezmi Mutlu, et al.
0

In this technical report, we introduce TempT, a novel method for test time adaptation on videos by ensuring temporal coherence of predictions across sequential frames. TempT is a powerful tool with broad applications in computer vision tasks, including facial expression recognition (FER) in videos. We evaluate TempT's performance on the AffWild2 dataset as part of the Expression Classification Challenge at the 5th Workshop and Competition on Affective Behavior Analysis in the wild (ABAW). Our approach focuses solely on the unimodal visual aspect of the data and utilizes a popular 2D CNN backbone, in contrast to larger sequential or attention based models. Our experimental results demonstrate that TempT has competitive performance in comparison to previous years reported performances, and its efficacy provides a compelling proof of concept for its use in various real world applications.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/22/2021

Expression Recognition Analysis in the Wild

Facial Expression Recognition(FER) is one of the most important topic in...
research
03/23/2022

Transformer-based Multimodal Information Fusion for Facial Expression Analysis

Facial expression analysis has been a crucial research problem in the co...
research
07/12/2021

Spatial and Temporal Networks for Facial Expression Recognition in the Wild Videos

The paper describes our proposed methodology for the seven basic express...
research
05/10/2022

Spatio-Temporal Transformer for Dynamic Facial Expression Recognition in the Wild

Previous methods for dynamic facial expression in the wild are mainly ba...
research
09/29/2020

Affect Expression Behaviour Analysis in the Wild using Spatio-Channel Attention and Complementary Context Information

Facial expression recognition(FER) in the wild is crucial for building r...
research
10/11/2019

Aff-Wild Database and AffWildNet

In the context of HCI, building an automatic system to recognize affect ...
research
07/09/2021

Seven Basic Expression Recognition Using ResNet-18

We propose to use a ResNet-18 architecture that was pre-trained on the F...

Please sign up or login with your details

Forgot password? Click here to reset