DeepAI AI Chat
Log In Sign Up

3D Human Reconstruction in the Wild with Collaborative Aerial Cameras

08/09/2021
by   Cherie Ho, et al.
Carnegie Mellon University
0

Aerial vehicles are revolutionizing applications that require capturing the 3D structure of dynamic targets in the wild, such as sports, medicine, and entertainment. The core challenges in developing a motion-capture system that operates in outdoors environments are: (1) 3D inference requires multiple simultaneous viewpoints of the target, (2) occlusion caused by obstacles is frequent when tracking moving targets, and (3) the camera and vehicle state estimation is noisy. We present a real-time aerial system for multi-camera control that can reconstruct human motions in natural environments without the use of special-purpose markers. We develop a multi-robot coordination scheme that maintains the optimal flight formation for target reconstruction quality amongst obstacles. We provide studies evaluating system performance in simulation, and validate real-world performance using two drones while a target performs activities such as jogging and playing soccer. Supplementary video: https://youtu.be/jxt91vx0cns

READ FULL TEXT

page 1

page 4

page 5

10/15/2019

Autonomous Aerial Cinematography In Unstructured Environments With Learned Artistic Decision-Making

Aerial cinematography is revolutionizing industries that require live an...
11/10/2020

Do You See What I See? Coordinating Multiple Aerial Cameras for Robot Cinematography

Aerial cinematography is significantly expanding the capabilities of fil...
10/29/2016

FlyCap: Markerless Motion Capture Using Multiple Autonomous Flying Cameras

Aiming at automatic, convenient and non-instrusive motion capture, this ...
11/19/2020

Batteries, camera, action! Learning a semantic control space for expressive robot cinematography

Aerial vehicles are revolutionizing the way film-makers can capture shot...