DeepAI AI Chat
Log In Sign Up

End-To-End Real-Time Visual Perception Framework for Construction Automation

by   Mohit Vohra, et al.

In this work, we present a robotic solution to automate the task of wall construction. To that end, we present an end-to-end visual perception framework that can quickly detect and localize bricks in a clutter. Further, we present a light computational method of brick pose estimation that incorporates the above information. The proposed detection network predicts a rotated box compared to YOLO and SSD, thereby maximizing the object's region in the predicted box regions. In addition, precision P, recall R, and mean-average-precision (mAP) scores are reported to evaluate the proposed framework. We observed that for our task, the proposed scheme outperforms the upright bounding box detectors. Further, we deploy the proposed visual perception framework on a robotic system endowed with a UR5 robot manipulator and demonstrate that the system can successfully replicate a simplified version of the wall-building task in an autonomous mode.


page 1

page 2

page 3

page 4

page 5


DirectPose: Direct End-to-End Multi-Person Pose Estimation

We propose the first direct end-to-end multi-person pose estimation fram...

HybridNets: End-to-End Perception Network

End-to-end Network has become increasingly important in multi-tasking. O...

ExtPerFC: An Efficient 2D and 3D Perception Hardware-Software Framework for Mobile Cobot

As the reliability of the robot's perception correlates with the number ...

Autonomous Wall Building with a UGV-UAV Team at MBZIRC 2020

Constructing large structures with robots is a challenging task with man...

Text Detection Recognition in the Wild for Robot Localization

Signage is everywhere and a robot should be able to take advantage of si...

WALL-E: Embodied Robotic WAiter Load Lifting with Large Language Model

Enabling robots to understand language instructions and react accordingl...

Whole-Body Bilateral Teleoperation of a Redundant Aerial Manipulator

Attaching a robotic manipulator to a flying base allows for significant ...