Part Segmentation for Highly Accurate Deformable Tracking in Occlusions via Fully Convolutional Neural Networks

08/05/2019
by   Weilin Wan, et al.
10

Successfully tracking the human body is an important perceptual challenge for robots that must work around people. Existing methods fall into two broad categories: geometric tracking and direct pose estimation using machine learning. While recent work has shown direct estimation techniques can be quite powerful, geometric tracking methods using point clouds can provide a very high level of 3D accuracy which is necessary for many robotic applications. However these approaches can have difficulty in clutter when large portions of the subject are occluded. To overcome this limitation, we propose a solution based on fully convolutional neural networks (FCN). We develop an optimized Fast-FCN network architecture for our application which allows us to filter observed point clouds and improve tracking accuracy while maintaining interactive frame rates. We also show that this model can be trained with a limited number of examples and almost no manual labelling by using an existing geometric tracker and data augmentation to automatically generate segmentation maps. We demonstrate the accuracy of our full system by comparing it against an existing geometric tracker, and show significant improvement in these challenging scenarios.

READ FULL TEXT

page 1

page 3

page 4

page 6

research
12/14/2017

Point-wise Convolutional Neural Network

Deep learning with 3D data such as reconstructed point clouds and CAD mo...
research
01/07/2022

Multiresolution Fully Convolutional Networks to detect Clouds and Snow through Optical Satellite Images

Clouds and snow have similar spectral features in the visible and near-i...
research
07/10/2018

Towards Head Motion Compensation Using Multi-Scale Convolutional Neural Networks

Head pose estimation and tracking is useful in variety of medical applic...
research
02/17/2020

Fully Convolutional Neural Networks for Raw Eye Tracking Data Segmentation, Generation, and Reconstruction

In this paper, we use fully convolutional neural networks for the semant...
research
02/02/2022

On-Sensor Binarized Fully Convolutional Neural Network with A Pixel Processor Array

This work presents a method to implement fully convolutional neural netw...
research
06/20/2016

Detection and Tracking of Liquids with Fully Convolutional Networks

Recent advances in AI and robotics have claimed many incredible results ...
research
10/17/2017

Superpixels Based Marker Tracking Vs. Hue Thresholding In Rodent Biomechanics Application

Examining locomotion has improved our basic understanding of motor contr...

Please sign up or login with your details

Forgot password? Click here to reset