Multi-Domain Multi-Definition Landmark Localization for Small Datasets

03/19/2022
by   David Ferman, et al.
0

We present a novel method for multi image domain and multi-landmark definition learning for small dataset facial localization. Training a small dataset alongside a large(r) dataset helps with robust learning for the former, and provides a universal mechanism for facial landmark localization for new and/or smaller standard datasets. To this end, we propose a Vision Transformer encoder with a novel decoder with a definition agnostic shared landmark semantic group structured prior, that is learnt, as we train on more than one dataset concurrently. Due to our novel definition agnostic group prior the datasets may vary in landmark definitions and domains. During the decoder stage we use cross- and self-attention, whose output is later fed into domain/definition specific heads that minimize a Laplacian-log-likelihood loss. We achieve state-of-the-art performance on standard landmark localization datasets such as COFW and WFLW, when trained with a bigger dataset. We also show state-of-the-art performance on several varied image domain small datasets for animals, caricatures, and facial portrait paintings. Further, we contribute a small dataset (150 images) of pareidolias to show efficacy of our method. Finally, we provide several analysis and ablation studies to justify our claims.

READ FULL TEXT

page 2

page 3

page 4

page 6

page 9

research
08/23/2022

Towards Accurate Facial Landmark Detection via Cascaded Transformers

Accurate facial landmarks are essential prerequisites for many tasks rel...
research
01/17/2021

Separable Batch Normalization for Robust Facial Landmark Localization with Cross-protocol Network Training

A big, diverse and balanced training data is the key to the success of d...
research
09/21/2021

LOTR: Face Landmark Localization Using Localization Transformer

This paper presents a novel Transformer-based facial landmark localizati...
research
11/24/2019

2D Wasserstein Loss for Robust Facial Landmark Detection

Facial landmark detection is an important preprocessing task for most ap...
research
11/24/2019

3FabRec: Fast Few-shot Face alignment by Reconstruction

Current supervised frameworks for facial landmark detection require a la...
research
03/27/2019

Laplace Landmark Localization

Landmark localization in images and videos is a classic problem solved i...
research
07/31/2022

One-Shot Medical Landmark Localization by Edge-Guided Transform and Noisy Landmark Refinement

As an important upstream task for many medical applications, supervised ...

Please sign up or login with your details

Forgot password? Click here to reset