Dynamic Object Tracking for Quadruped Manipulator with Spherical Image-Based Approach

07/14/2023
by   Tianlin Zhang, et al.
0

Exactly estimating and tracking the motion of surrounding dynamic objects is one of important tasks for the autonomy of a quadruped manipulator. However, with only an onboard RGB camera, it is still a challenging work for a quadruped manipulator to track the motion of a dynamic object moving with unknown and changing velocities. To address this problem, this manuscript proposes a novel image-based visual servoing (IBVS) approach consisting of three elements: a spherical projection model, a robust super-twisting observer, and a model predictive controller (MPC). The spherical projection model decouples the visual error of the dynamic target into linear and angular ones. Then, with the presence of the visual error, the robustness of the observer is exploited to estimate the unknown and changing velocities of the dynamic target without depth estimation. Finally, the estimated velocity is fed into the model predictive controller (MPC) to generate joint torques for the quadruped manipulator to track the motion of the dynamical target. The proposed approach is validated through hardware experiments and the experimental results illustrate the approach's effectiveness in improving the autonomy of the quadruped manipulator.

READ FULL TEXT

page 1

page 4

page 7

research
07/13/2018

Adaptive Model Predictive Control for High-Accuracy Trajectory Tracking in Changing Conditions

Robots and automated systems are being introduced to unknown and dynamic...
research
12/19/2022

Model Predictive Spherical Image-Based Visual Servoing On SO(3) for Aggressive Aerial Tracking

This paper presents an image-based visual servo control (IBVS) method fo...
research
10/05/2022

MOTSLAM: MOT-assisted monocular dynamic SLAM using single-view depth estimation

Visual SLAM systems targeting static scenes have been developed with sat...
research
11/16/2011

The Object Projection Feature Estimation Problem in Unsupervised Markerless 3D Motion Tracking

3D motion tracking is a critical task in many computer vision applicatio...
research
05/24/2020

Vision-based control of a knuckle boom crane with online cable length estimation

A vision-based controller for a knuckle boom crane is presented. The con...
research
10/07/2022

TRADE: Object Tracking with 3D Trajectory and Ground Depth Estimates for UAVs

We propose TRADE for robust tracking and 3D localization of a moving tar...
research
03/24/2021

A Framework for 3D Tracking of Frontal Dynamic Objects in Autonomous Cars

Both recognition and 3D tracking of frontal dynamic objects are crucial ...

Please sign up or login with your details

Forgot password? Click here to reset