A General Mobile Manipulator Automation Framework for Flexible Manufacturing in Hostile Industrial Environments

by   Can Pu, et al.

To enable a mobile manipulator to perform human tasks from a single teaching demonstration is vital to flexible manufacturing. We call our proposed method MMPA (Mobile Manipulator Process Automation with One-shot Teaching). Currently, there is no effective and robust MMPA framework which is not influenced by harsh industrial environments and the mobile base's parking precision. The proposed MMPA framework consists of two stages: collecting data (mobile base's location, environment information, end-effector's path) in the teaching stage for robot learning; letting the end-effector repeat the nearly same path as the reference path in the world frame to reproduce the work in the automation stage. More specifically, in the automation stage, the robot navigates to the specified location without the need of a precise parking. Then, based on colored point cloud registration, the proposed IPE (Iterative Pose Estimation by Eye Hand) algorithm could estimate the accurate 6D relative parking pose of the robot arm base without the need of any marker. Finally, the robot could learn the error compensation from the parking pose's bias to modify the end-effector's path to make it repeat a nearly same path in the world coordinate system as recorded in the teaching stage. Hundreds of trials have been conducted with a real mobile manipulator to show the superior robustness of the system and the accuracy of the process automation regardless of the harsh industrial conditions and parking precision. For the released code, please contact marketing@amigaga.com


page 2

page 7

page 11

page 14

page 16

page 17

page 21


Intelligent humanoids in manufacturing to address worker shortage and skill gaps: Case of Tesla Optimus

Technological evolution in the field of robotics is emerging with major ...

A Low Cost Vision Based Hybrid Fiducial Mark Tracking Technique for Mobile Industrial Robots

The field of robotic vision is developing rapidly. Robots can react inte...

Towards Robotic Laboratory Automation Plug Play: Teaching-free Robot Integration with the LAPP Digital Twin

The Laboratory Automation Plug Play (LAPP) framework is a high-level...

iRoPro: An interactive Robot Programming Framework

The great diversity of end-user tasks ranging from manufacturing environ...

Virtual Border Teaching Using a Network Robot System

Virtual borders are employed to allow users the flexible and interactive...

A Mobile Manipulation System for One-Shot Teaching of Complex Tasks in Homes

We describe a mobile manipulation hardware and software system capable o...

Towards Robotic Laboratory Automation Plug Play: The "LAPP" Framework

Increasing the level of automation in pharmaceutical laboratories and pr...

Please sign up or login with your details

Forgot password? Click here to reset