Team NimbRo at MBZIRC 2017: Autonomous Valve Stem Turning using a Wrench

by   Max Schwarz, et al.

The Mohamed Bin Zayed International Robotics Challenge (MBZIRC) 2017 has defined ambitious new benchmarks to advance the state-of-the-art in autonomous operation of ground-based and flying robots. In this article, we describe our winning entry to MBZIRC Challenge 2: the mobile manipulation robot Mario. It is capable of autonomously solving a valve manipulation task using a wrench tool detected, grasped, and finally employed to turn a valve stem. Mario's omnidirectional base allows both fast locomotion and precise close approach to the manipulation panel. We describe an efficient detector for medium-sized objects in 3D laser scans and apply it to detect the manipulation panel. An object detection architecture based on deep neural networks is used to find and select the correct tool from grayscale images. Parametrized motion primitives are adapted online to percepts of the tool and valve stem in order to turn the stem. We report in detail on our winning performance at the challenge and discuss lessons learned.



page 3

page 9

page 10

page 11

page 12

page 13

page 14

page 15


NimbRo Rescue: Solving Disaster-Response Tasks through Mobile Manipulation Robot Momaro

Robots that solve complex tasks in environments too dangerous for humans...

Team NimbRo at MBZIRC 2017: Fast Landing on a Moving Target and Treasure Hunting with a Team of MAVs

The Mohamed Bin Zayed International Robotics Challenge (MBZIRC) 2017 has...

Supervised Autonomous Locomotion and Manipulation for Disaster Response with a Centaur-like Robot

Mobile manipulation tasks are one of the key challenges in the field of ...

Tabletop Object Rearrangement: Team ACRV's Entry to OCRTOC

Open Cloud Robot Table Organization Challenge (OCRTOC) is one of the mos...

Autonomous Wall Building with a UGV-UAV Team at MBZIRC 2020

Constructing large structures with robots is a challenging task with man...

A Review of Robot Learning for Manipulation: Challenges, Representations, and Algorithms

A key challenge in intelligent robotics is creating robots that are capa...

Towards Mobile Multi-Task Manipulation in a Confined and Integrated Environment with Irregular Objects

The FetchIt! Mobile Manipulation Challenge, held at the IEEE Internation...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.