U-LanD: Uncertainty-Driven Video Landmark Detection

02/02/2021
by   Mohammad H. Jafari, et al.
0

This paper presents U-LanD, a framework for joint detection of key frames and landmarks in videos. We tackle a specifically challenging problem, where training labels are noisy and highly sparse. U-LanD builds upon a pivotal observation: a deep Bayesian landmark detector solely trained on key video frames, has significantly lower predictive uncertainty on those frames vs. other frames in videos. We use this observation as an unsupervised signal to automatically recognize key frames on which we detect landmarks. As a test-bed for our framework, we use ultrasound imaging videos of the heart, where sparse and noisy clinical labels are only available for a single frame in each video. Using data from 4,493 patients, we demonstrate that U-LanD can exceedingly outperform the state-of-the-art non-Bayesian counterpart by a noticeable absolute margin of 42 model size. Our approach is generic and can be potentially applied to other challenging data with noisy and sparse training labels.

READ FULL TEXT

page 1

page 4

page 7

research
06/13/2021

Learning the Imaging Landmarks: Unsupervised Key point Detection in Lung Ultrasound Videos

Lung ultrasound (LUS) is an increasingly popular diagnostic imaging moda...
research
01/27/2021

Reciprocal Landmark Detection and Tracking with Extremely Few Annotations

Localization of anatomical landmarks to perform two-dimensional measurem...
research
08/06/2021

Deep Learning-based Biological Anatomical Landmark Detection in Colonoscopy Videos

Colonoscopy is a standard imaging tool for visualizing the entire gastro...
research
07/03/2019

Learning Landmarks from Unaligned Data using Image Translation

We introduce a method for learning landmark detectors from unlabelled vi...
research
09/01/2021

Sparse to Dense Motion Transfer for Face Image Animation

Face image animation from a single image has achieved remarkable progres...
research
04/02/2023

Recurrence without Recurrence: Stable Video Landmark Detection with Deep Equilibrium Models

Cascaded computation, whereby predictions are recurrently refined over s...
research
01/09/2021

Detecting, Localising and Classifying Polyps from Colonoscopy Videos using Deep Learning

In this paper, we propose and analyse a system that can automatically de...

Please sign up or login with your details

Forgot password? Click here to reset