Markerless visual servoing on unknown objects for humanoid robot platforms

by   Claudio Fantacci, et al.

To precisely reach for an object with a humanoid robot, it is of central importance to have good knowledge of both end-effector, object pose and shape. In this work we propose a framework for markerless visual servoing on unknown objects, which is divided in four main parts: I) a least-squares minimization problem is formulated to find the volume of the object graspable by the robot's hand using its stereo vision; II) a recursive Bayesian filtering technique, based on Sequential Monte Carlo (SMC) filtering, estimates the 6D pose (position and orientation) of the robot's end-effector without the use of markers; III) a nonlinear constrained optimization problem is formulated to compute the desired graspable pose about the object; IV) an image-based visual servo control commands the robot's end-effector toward the desired pose. We demonstrate effectiveness and robustness of our approach with extensive experiments on the iCub humanoid robot platform, achieving real-time computation, smooth trajectories and sub-pixel precisions.


page 2

page 4


Trajectory Servoing: Image-Based Trajectory Tracking Using SLAM

This paper describes an image based visual servoing (IBVS) system for a ...

Human-robot collaborative object transfer using human motion prediction based on Cartesian pose Dynamic Movement Primitives

In this work, the problem of human-robot collaborative object transfer t...

Markerless Visual Robot Programming by Demonstration

In this paper we present an approach for learning to imitate human behav...

RNNPose: Recurrent 6-DoF Object Pose Refinement with Robust Correspondence Field Estimation and Pose Optimization

6-DoF object pose estimation from a monocular image is challenging, and ...

SURENA IV: Towards A Cost-effective Full-size Humanoid Robot for Real-world Scenarios

This paper describes the hardware, software framework, and experimental ...

Active Perception for Ambiguous Objects Classification

Recent visual pose estimation and tracking solutions provide notable res...

Localising Faster: Efficient and precise lidar-based robot localisation in large-scale environments

This paper proposes a novel approach for global localisation of mobile r...