MPPI-VS: Sampling-Based Model Predictive Control Strategy for Constrained Image-Based and Position-Based Visual Servoing

04/11/2021
by   Ihab S. Mohamed, et al.
0

In this paper, we open up new avenues for visual servoing systems built upon the Path Integral (PI) optimal control theory, in which the non-linear partial differential equation (PDE) can be transformed into an expectation over all possible trajectories using the Feynman-Kac (FK) lemma. More precisely, we propose an MPPI-VS control strategy, a real-time and inversion-free control strategy on the basis of sampling-based model predictive control (namely, Model Predictive Path Integral (MPPI) control) algorithm, for both image-based, 3D point, and position-based visual servoing techniques, taking into account the system constraints (such as visibility, 3D, and control constraints) and parametric uncertainties associated with the robot and camera models as well as measurement noise. Contrary to classical visual servoing control schemes, our control strategy directly utilizes the approximation of the interaction matrix, without the need for estimating the interaction matrix inversion or performing the pseudo-inversion. We validate the MPPI-VS control strategy as well as the classical control schemes on a 6-DoF Cartesian robot with an eye-in-hand camera based on the utilization of four points in the image plane as visual features. To better assess and demonstrate the robustness and potential advantages of our proposed control strategy compared to classical schemes, intensive simulations under various operating conditions are carried out and then discussed. The obtained results demonstrate the effectiveness and capability of the proposed scheme in coping easily with the system constraints, as well as its robustness in the presence of large errors in camera parameters and measurements.

READ FULL TEXT
research
05/02/2022

Chance-Constrained Stochastic Optimal Control via Path Integral and Finite Difference Methods

This paper addresses a continuous-time continuous-space chance-constrain...
research
10/06/2017

Model Predictive Path-Following for Constrained Differentially Flat Systems

For many tasks, predictive path-following control can significantly impr...
research
01/20/2022

DFBVS: Deep Feature-Based Visual Servo

Classical Visual Servoing (VS) rely on handcrafted visual features, whic...
research
12/19/2022

Model Predictive Spherical Image-Based Visual Servoing On SO(3) for Aggressive Aerial Tracking

This paper presents an image-based visual servo control (IBVS) method fo...
research
09/07/2023

Occlusion-Free Image Based Visual Servoing using Probabilistic Control Barrier Certificates

Image-based visual servoing (IBVS) is a widely-used approach in robotics...
research
09/22/2021

PCVPC: Perception Constrained Visual Predictive Control For Agile Quadrotors

We present a perception constrained visual predictive control (PCVPC) al...
research
12/17/2021

A controller for reaching and unveiling a partially occluded object of interest with an eye-in-hand robot

In this work, a control scheme for approaching and unveiling a partially...

Please sign up or login with your details

Forgot password? Click here to reset