Markerless visual servoing on unknown objects for humanoid robot platforms

10/12/2017
by   Claudio Fantacci, et al.
0

To precisely reach for an object with a humanoid robot, it is of central importance to have good knowledge of both end-effector, object pose and shape. In this work we propose a framework for markerless visual servoing on unknown objects, which is divided in four main parts: I) a least-squares minimization problem is formulated to find the volume of the object graspable by the robot's hand using its stereo vision; II) a recursive Bayesian filtering technique, based on Sequential Monte Carlo (SMC) filtering, estimates the 6D pose (position and orientation) of the robot's end-effector without the use of markers; III) a nonlinear constrained optimization problem is formulated to compute the desired graspable pose about the object; IV) an image-based visual servo control commands the robot's end-effector toward the desired pose. We demonstrate effectiveness and robustness of our approach with extensive experiments on the iCub humanoid robot platform, achieving real-time computation, smooth trajectories and sub-pixel precisions.

READ FULL TEXT

page 2

page 4

research
11/24/2022

Real-Time Physics-Based Object Pose Tracking during Non-Prehensile Manipulation

We propose a method to track the 6D pose of an object over time, while t...
research
02/26/2021

Trajectory Servoing: Image-Based Trajectory Tracking Using SLAM

This paper describes an image based visual servoing (IBVS) system for a ...
research
04/07/2021

Human-robot collaborative object transfer using human motion prediction based on Cartesian pose Dynamic Movement Primitives

In this work, the problem of human-robot collaborative object transfer t...
research
07/30/2018

Markerless Visual Robot Programming by Demonstration

In this paper we present an approach for learning to imitate human behav...
research
08/30/2021

SURENA IV: Towards A Cost-effective Full-size Humanoid Robot for Real-world Scenarios

This paper describes the hardware, software framework, and experimental ...
research
11/08/2022

Machine Learning-based Framework for Optimally Solving the Analytical Inverse Kinematics for Redundant Manipulators

Solving the analytical inverse kinematics (IK) of redundant manipulators...
research
03/04/2020

Localising Faster: Efficient and precise lidar-based robot localisation in large-scale environments

This paper proposes a novel approach for global localisation of mobile r...

Please sign up or login with your details

Forgot password? Click here to reset