Skin feature point tracking using deep feature encodings

12/28/2021
by   Jose Ramon Chang, et al.
16

Facial feature tracking is a key component of imaging ballistocardiography (BCG) where accurate quantification of the displacement of facial keypoints is needed for good heart rate estimation. Skin feature tracking enables video-based quantification of motor degradation in Parkinson's disease. Traditional computer vision algorithms include Scale Invariant Feature Transform (SIFT), Speeded-Up Robust Features (SURF), and Lucas-Kanade method (LK). These have long represented the state-of-the-art in efficiency and accuracy but fail when common deformations, like affine local transformations or illumination changes, are present. Over the past five years, deep convolutional neural networks have outperformed traditional methods for most computer vision tasks. We propose a pipeline for feature tracking, that applies a convolutional stacked autoencoder to identify the most similar crop in an image to a reference crop containing the feature of interest. The autoencoder learns to represent image crops into deep feature encodings specific to the object category it is trained on. We train the autoencoder on facial images and validate its ability to track skin features in general using manually labeled face and hand videos. The tracking errors of distinctive skin features (moles) are so small that we cannot exclude that they stem from the manual labelling based on a χ^2-test. With a mean error of 0.6-4.2 pixels, our method outperformed the other methods in all but one scenario. More importantly, our method was the only one to not diverge. We conclude that our method creates better feature descriptors for feature tracking, feature matching, and image registration than the traditional algorithms.

READ FULL TEXT

page 4

page 14

page 16

page 17

page 23

page 30

page 31

page 32

research
07/12/2012

ROI Segmentation for Feature Extraction from Human Facial Images

Human Computer Interaction (HCI) is the biggest goal of computer vision ...
research
05/30/2022

Exploring Advances in Transformers and CNN for Skin Lesion Diagnosis on Small Datasets

Skin cancer is one of the most common types of cancer in the world. Diff...
research
12/12/2012

Enhanced skin colour classifier using RGB Ratio model

Skin colour detection is frequently been used for searching people, face...
research
07/06/2012

An Innovative Skin Detection Approach Using Color Based Image Retrieval Technique

From The late 90th, "Skin Detection" becomes one of the major problems i...
research
03/20/2018

Transferring Rich Deep Features for Facial Beauty Prediction

Feature extraction plays a significant part in computer vision tasks. In...
research
05/09/2014

Better Feature Tracking Through Subspace Constraints

Feature tracking in video is a crucial task in computer vision. Usually,...
research
07/05/2018

Jigsaw Puzzle Solving Using Local Feature Co-Occurrences in Deep Neural Networks

Archaeologists are in dire need of automated object reconstruction metho...

Please sign up or login with your details

Forgot password? Click here to reset