D-VAT: End-to-End Visual Active Tracking for Micro Aerial Vehicles

08/31/2023
by   Alberto Dionigi, et al.
0

Visual active tracking is a growing research topic in robotics due to its key role in applications such as human assistance, disaster recovery, and surveillance. In contrast to passive tracking, active tracking approaches combine vision and control capabilities to detect and actively track the target. Most of the work in this area focuses on ground robots, while the very few contributions on aerial platforms still pose important design constraints that limit their applicability. To overcome these limitations, in this paper we propose D-VAT, a novel end-to-end visual active tracking methodology based on deep reinforcement learning that is tailored to micro aerial vehicle platforms. The D-VAT agent computes the vehicle thrust and angular velocity commands needed to track the target by directly processing monocular camera measurements. We show that the proposed approach allows for precise and collision-free tracking operations, outperforming different state-of-the-art baselines on simulated environments which differ significantly from those encountered during training.

READ FULL TEXT

page 1

page 5

page 7

research
09/28/2020

Enhancing Continuous Control of Mobile Robots for End-to-End Visual Active Tracking

In the last decades, visual target tracking has been one of the primary ...
research
02/05/2018

Deep Neural Network-based Cooperative Visual Tracking through Multiple Micro Aerial Vehicles

Multi-camera full-body pose capture of humans and animals in outdoor env...
research
12/18/2021

Space Non-cooperative Object Active Tracking with Deep Reinforcement Learning

Active visual tracking of space non-cooperative object is significant fo...
research
01/23/2019

Active Perception based Formation Control for Multiple Aerial Vehicles

Autonomous motion capture (mocap) systems for outdoor scenarios involvin...
research
04/16/2019

Are State-of-the-art Visual Place Recognition Techniques any Good for Aerial Robotics?

Visual Place Recognition (VPR) has seen significant advances at the fron...
research
12/06/2022

Collision-tolerant Aerial Robots: A Survey

As aerial robots are tasked to navigate environments of increased comple...
research
11/21/2022

PVT++: A Simple End-to-End Latency-Aware Visual Tracking Framework

Visual object tracking is an essential capability of intelligent robots....

Please sign up or login with your details

Forgot password? Click here to reset