AirCapRL: Autonomous Aerial Human Motion Capture using Deep Reinforcement Learning

by   Rahul Tallamraju, et al.

In this letter, we introduce a deep reinforcement learning (RL) based multi-robot formation controller for the task of autonomous aerial human motion capture (MoCap). We focus on vision-based MoCap, where the objective is to estimate the trajectory of body pose and shape of a single moving person using multiple micro aerial vehicles. State-of-the-art solutions to this problem are based on classical control methods, which depend on hand-crafted system and observation models. Such models are difficult to derive and generalize across different systems. Moreover, the non-linearity and non-convexities of these models lead to sub-optimal controls. In our work, we formulate this problem as a sequential decision making task to achieve the vision-based motion capture objectives, and solve it using a deep neural network-based RL method. We leverage proximal policy optimization (PPO) to train a stochastic decentralized control policy for formation control. The neural network is trained in a parallelized setup in synthetic environments. We performed extensive simulation experiments to validate our approach. Finally, real-robot experiments demonstrate that our policies generalize to real world conditions. Video Link: Supplementary:


page 1

page 8


DeXtreme: Transfer of Agile In-hand Manipulation from Simulation to Reality

Recent work has demonstrated the ability of deep reinforcement learning ...

Generalization through Simulation: Integrating Simulated and Real Data into Deep Reinforcement Learning for Vision-Based Autonomous Flight

Deep reinforcement learning provides a promising approach for vision-bas...

Learning to Open Doors with an Aerial Manipulator

The field of aerial manipulation has seen rapid advances, transitioning ...

Harfang3D Dog-Fight Sandbox: A Reinforcement Learning Research Platform for the Customized Control Tasks of Fighter Aircrafts

The advent of deep learning (DL) gave rise to significant breakthroughs ...

LBGP: Learning Based Goal Planning for Autonomous Following in Front

This paper investigates a hybrid solution which combines deep reinforcem...

Reinforcement Learning based Autonomous Multi-Rotor Landing on Moving Platforms

Multi-rotor UAVs suffer from a restricted range and flight duration due ...

Can a Robot Become a Movie Director? Learning Artistic Principles for Aerial Cinematography

Aerial filming is becoming more and more popular thanks to the recent ad...

Please sign up or login with your details

Forgot password? Click here to reset