Unsupervised Learning of Landmarks based on Inter-Intra Subject Consistencies

04/16/2020
by   Weijian Li, et al.
0

We present a novel unsupervised learning approach to image landmark discovery by incorporating the inter-subject landmark consistencies on facial images. This is achieved via an inter-subject mapping module that transforms original subject landmarks based on an auxiliary subject-related structure. To recover from the transformed images back to the original subject, the landmark detector is forced to learn spatial locations that contain the consistent semantic meanings both for the paired intra-subject images and between the paired inter-subject images. Our proposed method is extensively evaluated on two public facial image datasets (MAFL, AFLW) with various settings. Experimental results indicate that our method can extract the consistent landmarks for both datasets and achieve better performances compared to the previous state-of-the-art methods quantitatively and qualitatively.

READ FULL TEXT

page 3

page 5

research
05/31/2022

From Keypoints to Object Landmarks via Self-Training Correspondence: A novel approach to Unsupervised Landmark Discovery

This paper proposes a novel paradigm for the unsupervised learning of ob...
research
09/05/2017

Improving Landmark Localization with Semi-Supervised Learning

We present two techniques to improve landmark localization from partiall...
research
03/14/2023

Precise Facial Landmark Detection by Reference Heatmap Transformer

Most facial landmark detection methods predict landmarks by mapping the ...
research
04/07/2021

Pretrained equivariant features improve unsupervised landmark discovery

Locating semantically meaningful landmark points is a crucial component ...
research
05/17/2020

Subject Identification Across Large Expression Variations Using 3D Facial Landmarks

Landmark localization is an important first step towards geometric based...
research
08/18/2019

Unsupervised Learning of Landmarks by Descriptor Vector Exchange

Equivariance to random image transformations is an effective method to l...
research
04/17/2020

Structured Landmark Detection via Topology-Adapting Deep Graph Learning

Image landmark detection aims to automatically identify the locations of...

Please sign up or login with your details

Forgot password? Click here to reset