SkyQuery: An Aerial Drone Video Sensing Platform

by   Favyen Bastani, et al.

Video-based sensing from aerial drones, especially small multirotor drones, can provide rich data for numerous applications, including traffic analysis (computing traffic flow volumes), precision agriculture (periodically evaluating plant health), and wildlife population management (estimating population sizes). However, aerial drone video sensing applications must handle a surprisingly wide range of tasks: video frames must be aligned so that we can equate coordinates of objects that appear in different frames, video data must be analyzed to extract application-specific insights, and drone routes must be computed that maximize the value of newly captured video. To address these challenges, we built SkyQuery, a novel aerial drone video sensing platform that provides an expressive, high-level programming language to make it straightforward for users to develop complex long-running sensing applications. SkyQuery combines novel methods for fast video frame alignment and detection of small objects in top-down aerial drone video to efficiently execute applications with diverse video analysis workflows and data distributions, thereby allowing application developers to focus on the unique qualities of their particular application rather than general video processing, data analysis, and drone routing tasks. We conduct diverse case studies using SkyQuery in parking monitoring, pedestrian activity mapping, and traffic hazard detection scenarios to demonstrate the generalizability and effectiveness of our system.


page 2

page 4

page 7

page 10


Drone Shadow Tracking

Aerial videos taken by a drone not too far above the surface may contain...

Unmanned Aerial Vehicle Path Planning for Traffic Estimation and Detection of Non-Recurrent Congestion

Unmanned aerial vehicles (drones) can be used in traffic and road monito...

Deep Multimodality Learning for UAV Video Aesthetic Quality Assessment

Despite the growing number of unmanned aerial vehicles (UAVs) and aerial...

An Insight into the Dynamics and State Space Modelling of a 3-D Quadrotor

Drones have gained popularity in a wide range of field ranging from aeri...

Towards Live Video Analytics with On-Drone Deeper-yet-Compatible Compression

In this work, we present DCC(Deeper-yet-Compatible Compression), one ena...

Towards Affective Drone Swarms: A Preliminary Crowd-Sourced Study

Drone swarms are teams of autonomous un-manned aerial vehicles that act ...

Spatio-temporal Consistency to Detect Potential Aedes aegypti Breeding Grounds in Aerial Video Sequences

Every year, the Aedes aegypti mosquito infects thousands of people with ...