Towards a Drone Cinematographer: Guiding Quadrotor Cameras using Visual Composition Principles

10/05/2016
by   Niels Joubert, et al.
0

We present a system to capture video footage of human subjects in the real world. Our system leverages a quadrotor camera to automatically capture well-composed video of two subjects. Subjects are tracked in a large-scale outdoor environment using RTK GPS and IMU sensors. Then, given the tracked state of our subjects, our system automatically computes static shots based on well-established visual composition principles and canonical shots from cinematography literature. To transition between these static shots, we calculate feasible, safe, and visually pleasing transitions using a novel real-time trajectory planning algorithm. We evaluate the performance of our tracking system, and experimentally show that RTK GPS significantly outperforms conventional GPS in capturing a variety of canonical shots. Lastly, we demonstrate our system guiding a consumer quadrotor camera autonomously capturing footage of two subjects in a variety of use cases. This is the first end-to-end system that enables people to leverage the mobility of quadrotors, as well as the knowledge of expert filmmakers, to autonomously capture high-quality footage of people in the real world.

READ FULL TEXT

page 1

page 3

page 5

page 7

page 8

research
10/21/2020

Can We Enable the Drone to be a Filmmaker?

Drones are enabling new forms of cinematography. However, quadrotor cine...
research
01/02/2022

VISAS – Detecting GPS spoofing attacks against drones by analyzing camera's video stream

In this study, we propose an innovative method for the real-time detecti...
research
12/05/2016

Turning an Urban Scene Video into a Cinemagraph

This paper proposes an algorithm that turns a regular video capturing ur...
research
07/05/2022

Drone Detection and Tracking in Real-Time by Fusion of Different Sensing Modalities

Automatic detection of flying drones is a key issue where its presence, ...
research
04/11/2016

Capturing Dynamic Textured Surfaces of Moving Targets

We present an end-to-end system for reconstructing complete watertight a...
research
12/09/2015

Sensor Fusion of Camera, GPS and IMU using Fuzzy Adaptive Multiple Motion Models

A tracking system that will be used for Augmented Reality (AR) applicati...
research
06/05/2023

TRACE: 5D Temporal Regression of Avatars with Dynamic Cameras in 3D Environments

Although the estimation of 3D human pose and shape (HPS) is rapidly prog...

Please sign up or login with your details

Forgot password? Click here to reset