Real-time Multiple People Hand Localization in 4D Point Clouds

03/05/2019
by   Hao Jiang, et al.
0

We propose novel real-time algorithm to localize hands and find their associations with multiple people in the cluttered 4D volumetric data (dynamic 3D volumes). Different from the traditional multiple view approaches, which find key points in 2D and then triangulate to recover the 3D locations, our method directly processes the dynamic 3D data that involve both clutter and crowd. The volumetric representation is more desirable than the partial observations from different view points and enables more robust and accurate results. However, due to the large amount of data in the volumetric representation brute force 3D schemes are slow. In this paper, we propose novel real-time methods to tackle the problem to achieve both higher accuracy and faster speed than previous approaches. Our method detects the 3D bounding box of each subject and localizes the hands of each person. We develop new 2D features for fast candidate proposals and optimize the trajectory linking using a new max-covering bipartite matching formulation, which is critical for robust performance. We propose a novel decomposition method to reduce the key point localization in each person 3D volume to a sequence of efficient 2D problems. Our experiments show that the proposed method is faster than different competing methods and it gives almost half the localization error.

READ FULL TEXT

page 4

page 5

page 9

research
06/06/2018

Action4D: Real-time Action Recognition in the Crowd and Clutter

Recognizing every person's action in a crowded and cluttered environment...
research
11/05/2018

Deep BV: A Fully Automated System for Brain Ventricle Localization and Segmentation in 3D Ultrasound Images of Embryonic Mice

Volumetric analysis of brain ventricle (BV) structure is a key tool in t...
research
12/31/2021

P2P-Loc: Point to Point Tiny Person Localization

Bounding-box annotation form has been the most frequently used method fo...
research
11/16/2021

Hierarchical Topometric Representation of 3D Robotic Maps

In this paper, we propose a method for generating a hierarchical, volume...
research
07/22/2022

Faster VoxelPose: Real-time 3D Human Pose Estimation by Orthographic Projection

While the voxel-based methods have achieved promising results for multi-...
research
04/06/2020

Robust 3D Self-portraits in Seconds

In this paper, we propose an efficient method for robust 3D self-portrai...
research
09/17/2016

Optimisations for Real-Time Volumetric Cloudscapes

Volumetric cloudscapes are prohibitively expensive to render in real tim...

Please sign up or login with your details

Forgot password? Click here to reset