Model Predictive Spherical Image-Based Visual Servoing On SO(3) for Aggressive Aerial Tracking

12/19/2022
by   Chao Qin, et al.
0

This paper presents an image-based visual servo control (IBVS) method for a first-person-view (FPV) quadrotor to conduct aggressive aerial tracking. There are three major challenges to maneuvering an underactuated vehicle using IBVS: (i) finding a visual feature representation that is robust to large rotations and is suited to be an optimization variable; (ii) keeping the target visible without sacrificing the robot's agility; and (iii) compensating for the rotational effects in the detected features. We propose a complete design framework to address these problems. First, we employ a rotation on SO(3) to represent a spherical image feature on S^2 to gain singularity-free and second-order differentiable properties. To ensure target visibility, we formulate the IBVS as a nonlinear model predictive control (NMPC) problem with three constraints taken into account: the robot's physical limits, target visibility, and time-to-collision (TTC). Furthermore, we propose a novel attitude-compensation scheme to enable formulating the visibility constraint in the actual image plane instead of a virtual fix-orientation image plane. It guarantees that the visibility constraint is valid under large rotations. Extensive experimental results show that our method can track a fast-moving target stably and aggressively without the aid of a localization system.

READ FULL TEXT
research
09/22/2021

PCVPC: Perception Constrained Visual Predictive Control For Agile Quadrotors

We present a perception constrained visual predictive control (PCVPC) al...
research
07/14/2023

Dynamic Object Tracking for Quadruped Manipulator with Spherical Image-Based Approach

Exactly estimating and tracking the motion of surrounding dynamic object...
research
03/11/2021

Visibility-aware Trajectory Optimization with Application to Aerial Tracking

The visibility of targets determines performance and even success rate o...
research
02/09/2023

A Perception-Aware NMPC for Vision-Based Target Tracking and Collision Avoidance with a Multi-Rotor UAV

A perception-aware Nonlinear Model Predictive Control (NMPC) strategy ai...
research
04/11/2021

MPPI-VS: Sampling-Based Model Predictive Control Strategy for Constrained Image-Based and Position-Based Visual Servoing

In this paper, we open up new avenues for visual servoing systems built ...
research
09/24/2019

The Field-of-View Constraint of Markers for Mobile Robot with Pan-Tilt Camera

In the field of navigation and visual servo, it is common to calculate r...
research
11/18/2019

Strategy Synthesis for Surveillance-Evasion Games with Learning-Enabled Visibility Optimization

This paper studies a two-player game with a quantitative surveillance re...

Please sign up or login with your details

Forgot password? Click here to reset