Visually Guided UGV for Autonomous Mobile Manipulation in Dynamic and Unstructured GPS Denied Environments

12/15/2021
by   Mohit Vohra, et al.
0

A robotic solution for the unmanned ground vehicles (UGVs) to execute the highly complex task of object manipulation in an autonomous mode is presented. This paper primarily focuses on developing an autonomous robotic system capable of assembling elementary blocks to build the large 3D structures in GPS-denied environments. The key contributions of this system paper are i) Designing of a deep learning-based unified multi-task visual perception system for object detection, part-detection, instance segmentation, and tracking, ii) an electromagnetic gripper design for robust grasping, and iii) system integration in which multiple system components are integrated to develop an optimized software stack. The entire mechatronic and algorithmic design of UGV for the above application is detailed in this work. The performance and efficacy of the overall system are reported through several rigorous experiments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/16/2021

Towards Deep Learning Assisted Autonomous UAVs for Manipulation Tasks in GPS-Denied Environments

In this work, we present a pragmatic approach to enable unmanned aerial ...
research
06/07/2020

Multi-Task Reinforcement Learning based Mobile Manipulation Control for Dynamic Object Tracking and Grasping

Agile control of mobile manipulator is challenging because of the high c...
research
01/14/2022

UGV-UAV Object Geolocation in Unstructured Environments

A robotic system of multiple unmanned ground vehicles (UGVs) and unmanne...
research
10/01/2018

RGB-D Object Detection and Semantic Segmentation for Autonomous Manipulation in Clutter

Autonomous robotic manipulation in clutter is challenging. A large varie...
research
08/22/2022

Robotic Perception in Agri-food Manipulation: A Review

To better optimise the global food supply chain, robotic solutions are n...
research
04/02/2020

Go Fetch: Mobile Manipulation in Unstructured Environments

With humankind facing new and increasingly large-scale challenges in the...
research
11/15/2022

Deep Instance Segmentation and Visual Servoing to Play Jenga with a Cost-Effective Robotic System

The game of Jenga represents an inspiring benchmark for developing innov...

Please sign up or login with your details

Forgot password? Click here to reset