FlyCap: Markerless Motion Capture Using Multiple Autonomous Flying Cameras

10/29/2016
by   Lan Xu, et al.
0

Aiming at automatic, convenient and non-instrusive motion capture, this paper presents a new generation markerless motion capture technique, the FlyCap system, to capture surface motions of moving characters using multiple autonomous flying cameras (autonomous unmanned aerial vehicles(UAV) each integrated with an RGBD video camera). During data capture, three cooperative flying cameras automatically track and follow the moving target who performs large scale motions in a wide space. We propose a novel non-rigid surface registration method to track and fuse the depth of the three flying cameras for surface motion tracking of the moving target, and simultaneously calculate the pose of each flying camera. We leverage the using of visual-odometry information provided by the UAV platform, and formulate the surface tracking problem in a non-linear objective function that can be linearized and effectively minimized through a Gaussian-Newton method. Quantitative and qualitative experimental results demonstrate the competent and plausible surface and motion reconstruction results

READ FULL TEXT
research
10/09/2018

Skeleton Driven Non-rigid Motion Tracking and 3D Reconstruction

This paper presents a method which can track and 3D reconstruct the non-...
research
12/12/2017

Automated Cinematography with Unmanned Aerial Vehicles

The rise of Unmanned Aerial Vehicles and their increasing use in the cin...
research
10/09/2017

Visual Servoing of Unmanned Surface Vehicle from Small Tethered Unmanned Aerial Vehicle

This paper presents an algorithm and the implementation of a motor schem...
research
03/21/2021

UAV Images Dataset for Moving Object Detection from Moving Cameras

This paper presents a new high resolution aerial images dataset in which...
research
08/09/2021

3D Human Reconstruction in the Wild with Collaborative Aerial Cameras

Aerial vehicles are revolutionizing applications that require capturing ...
research
12/01/2016

Flight Dynamics-based Recovery of a UAV Trajectory using Ground Cameras

We propose a new method to estimate the 6-dof trajectory of a flying obj...
research
01/23/2019

Active Perception based Formation Control for Multiple Aerial Vehicles

Autonomous motion capture (mocap) systems for outdoor scenarios involvin...

Please sign up or login with your details

Forgot password? Click here to reset