PCVPC: Perception Constrained Visual Predictive Control For Agile Quadrotors

09/22/2021
by   Chao Qin, et al.
0

We present a perception constrained visual predictive control (PCVPC) algorithm for quadrotors to enable aggressive flights without using any position information. Our framework leverages nonlinear model predictive control (NMPC) to formulate a constrained image-based visual servoing (IBVS) problem. The quadrotor dynamics, image dynamics, actuation constraints, and visibility constraints are taken into account to handle quadrotor maneuvers with high agility. Two main challenges of applying IBVS to agile drones are considered: (i) high sensitivity of depths to intense orientation changes, and (ii) conflict between the visual servoing objective and action objective due to the underactuated nature. To deal with the first challenge, we parameterize a visual feature by a bearing vector and a distance, by which the depth will no longer be involved in the image dynamics. Meanwhile, we settle the conflict problem by compensating for the rotation in the future visual servoing cost using the predicted orientations of the quadrotor. Our approach in simulation shows that (i) it can work without any position information, (ii) it can achieve a maximum referebce speed of 9 m/s in trajectory tracking without losing the target, and (iii) it can reach a landmark, e.g., a gate in drone racing, from varied initial configurations.

READ FULL TEXT

page 1

page 4

research
12/19/2022

Model Predictive Spherical Image-Based Visual Servoing On SO(3) for Aggressive Aerial Tracking

This paper presents an image-based visual servo control (IBVS) method fo...
research
04/13/2018

PAMPC: Perception-Aware Model Predictive Control for Quadrotors

We present a perception-aware model predictive control framework for qua...
research
06/14/2023

Agile Catching with Whole-Body MPC and Blackbox Policy Learning

We address a benchmark task in agile robotics: catching objects thrown a...
research
01/07/2020

Aggressive Perception-Aware Navigation using Deep Optical Flow Dynamics and PixelMPC

Recently, vision-based control has gained traction by leveraging the pow...
research
04/11/2021

MPPI-VS: Sampling-Based Model Predictive Control Strategy for Constrained Image-Based and Position-Based Visual Servoing

In this paper, we open up new avenues for visual servoing systems built ...
research
04/06/2021

Nonlinear Model Based Guidance with Deep Learning Based Target Trajectory Prediction Against Aerial Agile Attack Patterns

In this work, we propose a novel missile guidance algorithm that combine...
research
08/06/2020

Online Weight-adaptive Nonlinear Model Predictive Control

Nonlinear Model Predictive Control (NMPC) is a powerful and widely used ...

Please sign up or login with your details

Forgot password? Click here to reset