Visibility Maximization Controller for Robotic Manipulation

02/25/2022
by   Kerry He, et al.
0

Occlusions caused by a robot's own body is a common problem for closed-loop control methods employed in eye-to-hand camera setups. We propose an optimization-based reactive controller that minimizes self-occlusions while achieving a desired goal pose. The approach allows coordinated control between the robot's base, arm and head by encoding the line-of-sight visibility to the target as a soft constraint along with other task-related constraints, and solving for feasible joint and base velocities. The generalizability of the approach is demonstrated in simulated and real-world experiments, on robots with fixed or mobile bases, with moving or fixed objects, and multiple objects. The experiments revealed a trade-off between occlusion rates and other task metrics. While a planning-based baseline achieved lower occlusion rates than the proposed controller, it came at the expense of highly inefficient paths and a significant drop in the task success. On the other hand, the proposed controller is shown to improve visibility to the line target object(s) without sacrificing too much from the task success and efficiency. Videos and code can be found at: rhys-newbury.github.io/projects/vmc/.

READ FULL TEXT

page 1

page 5

research
12/14/2022

An Architecture for Reactive Mobile Manipulation On-The-Move

We present a generalised architecture for reactive mobile manipulation w...
research
01/17/2023

Tactile Tool Manipulation

Humans can effortlessly perform very complex, dexterous manipulation tas...
research
12/08/2017

Sim-to-Real Transfer of Accurate Grasping with Eye-In-Hand Observations and Continuous Control

In the context of deep learning for robotics, we show effective method o...
research
03/04/2022

Whole-Body MPC and Dynamic Occlusion Avoidance: A Maximum Likelihood Visibility Approach

This paper introduces a novel approach for whole-body motion planning an...
research
03/16/2022

On-The-Go Robot-to-Human Handovers with a Mobile Manipulator

Existing approaches to direct robot-to-human handovers are typically imp...
research
04/21/2023

Emergent Cooperative Behavior in Distributed Target Tracking with Unknown Occlusions

Tracking multiple moving objects of interest (OOI) with multiple robot s...
research
09/28/2022

Carrying the uncarriable: a deformation-agnostic and human-cooperative framework for unwieldy objects using multiple robots

This manuscript introduces an object deformability-agnostic framework fo...

Please sign up or login with your details

Forgot password? Click here to reset