A sensor-to-pattern calibration framework for multi-modal industrial collaborative cells

10/19/2022
by   Daniela Rato, et al.
0

Collaborative robotic industrial cells are workspaces where robots collaborate with human operators. In this context, safety is paramount, and for that a complete perception of the space where the collaborative robot is inserted is necessary. To ensure this, collaborative cells are equipped with a large set of sensors of multiple modalities, covering the entire work volume. However, the fusion of information from all these sensors requires an accurate extrinsic calibration. The calibration of such complex systems is challenging, due to the number of sensors and modalities, and also due to the small overlapping fields of view between the sensors, which are positioned to capture different viewpoints of the cell. This paper proposes a sensor to pattern methodology that can calibrate a complex system such as a collaborative cell in a single optimization procedure. Our methodology can tackle RGB and Depth cameras, as well as LiDARs. Results show that our methodology is able to accurately calibrate a collaborative cell containing three RGB cameras, a depth camera and three 3D LiDARs.

READ FULL TEXT

page 1

page 5

page 6

page 7

page 9

page 10

research
09/28/2021

Targetless Extrinsic Calibration of Stereo Cameras, Thermal Cameras, and Laser Sensors in the Wild

The fusion of multi-modal sensors has become increasingly popular in aut...
research
07/14/2018

Extrinsic Calibration of Multiple RGB-D Cameras Based on Descriptor-based Patterns

This letter presents a novel method to estimate the relative poses betwe...
research
09/15/2023

GelSplitter: Tactile Reconstruction from Near Infrared and Visible Images

The GelSight-like visual tactile (VT) sensor has gained popularity as a ...
research
05/12/2023

Multi-Modal 3D Object Detection by Box Matching

Multi-modal 3D object detection has received growing attention as the in...
research
01/20/2017

Robust Intrinsic and Extrinsic Calibration of RGB-D Cameras

Color-depth cameras (RGB-D cameras) have become the primary sensors in m...
research
10/06/2019

Enhanced Human-Machine Interaction by Combining Proximity Sensing with Global Perception

The raise of collaborative robotics has led to wide range of sensor tech...
research
05/24/2020

Learning Camera Miscalibration Detection

Self-diagnosis and self-repair are some of the key challenges in deployi...

Please sign up or login with your details

Forgot password? Click here to reset