ViTASD: Robust Vision Transformer Baselines for Autism Spectrum Disorder Facial Diagnosis

10/30/2022
by   Xu Cao, et al.
0

Autism spectrum disorder (ASD) is a lifelong neurodevelopmental disorder with very high prevalence around the world. Research progress in the field of ASD facial analysis in pediatric patients has been hindered due to a lack of well-established baselines. In this paper, we propose the use of the Vision Transformer (ViT) for the computational analysis of pediatric ASD. The presented model, known as ViTASD, distills knowledge from large facial expression datasets and offers model structure transferability. Specifically, ViTASD employs a vanilla ViT to extract features from patients' face images and adopts a lightweight decoder with a Gaussian Process layer to enhance the robustness for ASD analysis. Extensive experiments conducted on standard ASD facial analysis benchmarks show that our method outperforms all of the representative approaches in ASD facial analysis, while the ViTASD-L achieves a new state-of-the-art. Our code and pretrained models are available at https://github.com/IrohXu/ViTASD.

READ FULL TEXT

page 2

page 4

research
11/24/2022

More comprehensive facial inversion for more effective expression recognition

Facial expression recognition (FER) plays a significant role in the ubiq...
research
08/25/2023

Prompting Visual-Language Models for Dynamic Facial Expression Recognition

This paper presents a novel visual-language model called DFER-CLIP, whic...
research
09/20/2021

MFEViT: A Robust Lightweight Transformer-based Network for Multimodal 2D+3D Facial Expression Recognition

Vision transformer (ViT) has been widely applied in many areas due to it...
research
07/24/2022

Affective Behaviour Analysis Using Pretrained Model with Facial Priori

Affective behaviour analysis has aroused researchers' attention due to i...
research
03/25/2023

3D Facial Imperfection Regeneration: Deep learning approach and 3D printing prototypes

This study explores the potential of a fully convolutional mesh autoenco...
research
07/05/2023

MAE-DFER: Efficient Masked Autoencoder for Self-supervised Dynamic Facial Expression Recognition

Dynamic facial expression recognition (DFER) is essential to the develop...
research
01/08/2021

Unobtrusive Pain Monitoring in Older Adults with Dementia using Pairwise and Contrastive Training

Although pain is frequent in old age, older adults are often undertreate...

Please sign up or login with your details

Forgot password? Click here to reset