Vision-Guided Active Tactile Perception for Crack Detection and Reconstruction

05/13/2021
by   Jiaqi Jiang, et al.
5

Crack detection is of great significance for monitoring the integrity and well-being of the infrastructure such as bridges and underground pipelines, which are harsh environments for people to access. In recent years, computer vision techniques have been applied in detecting cracks in concrete structures. However, they suffer from variances in light conditions and shadows, lacking robustness and resulting in many false positives. To address the uncertainty in vision, human inspectors actively touch the surface of the structures, guided by vision, which has not been explored in autonomous crack detection. In this paper, we propose a novel approach to detect and reconstruct cracks in concrete structures using vision-guided active tactile perception. Given an RGB-D image of a structure, the rough profile of the crack in the structure surface will first be segmented with a fine-tuned Deep Convolutional Neural Networks, and a set of contact points are generated to guide the collection of tactile images by a camera-based optical tactile sensor. When contacts are made, a pixel-wise mask of the crack can be obtained from the tactile images and therefore the profile of the crack can be refined by aligning the RGB-D image and the tactile images. Extensive experiment results have shown that the proposed method improves the effectiveness and robustness of crack detection and reconstruction significantly, compared to crack detection with vision only, and has the potential to enable robots to help humans with the inspection and repair of the concrete infrastructure.

READ FULL TEXT

page 1

page 3

page 4

page 5

research
01/04/2022

DenseTact: Optical Tactile Sensor for Dense Shape Reconstruction

Increasing the performance of tactile sensing in robots enables versatil...
research
09/22/2020

Detection Of Concrete Cracks using Dual-channel Deep Convolutional Network

Due to cyclic loading and fatigue stress cracks are generated, which aff...
research
03/02/2020

Fabric Defect Detection Using Vision-Based Tactile Sensor

This paper introduces a new type of system for fabric defect detection w...
research
11/02/2017

Active Clothing Material Perception using Tactile Sensing and Deep Learning

Humans represent the objects in the same category using their properties...
research
09/14/2022

Tac2Structure: Object Surface Reconstruction Only through Multi Times Touch

Inspired by the ability of humans to perceive the surface texture of unf...
research
08/03/2022

Image-based Detection of Surface Defects in Concrete during Construction

Defects increase the cost and duration of construction projects. Automat...

Please sign up or login with your details

Forgot password? Click here to reset