Robot Pose Nowcasting: Forecast the Future to Improve the Present

08/24/2023
by   Alessandro Simoni, et al.
0

In recent years, the effective and safe collaboration between humans and machines has gained significant importance, particularly in the Industry 4.0 scenario. A critical prerequisite for realizing this collaborative paradigm is precisely understanding the robot's 3D pose within its environment. Therefore, in this paper, we introduce a novel vision-based system leveraging depth data to accurately establish the 3D locations of robotic joints. Specifically, we prove the ability of the proposed system to enhance its current pose estimation accuracy by jointly learning to forecast future poses. Indeed, we introduce the concept of Pose Nowcasting, denoting the capability of a system to exploit the learned knowledge of the future to improve the estimation of the present. The experimental evaluation is conducted on two different datasets, providing state-of-the-art and real-time performance and confirming the validity of the proposed method on both the robotic and human scenarios.

READ FULL TEXT

page 3

page 8

research
07/06/2022

Semi-Perspective Decoupled Heatmaps for 3D Robot Pose Estimation from Depth Maps

Knowing the exact 3D location of workers and robots in a collaborative e...
research
01/18/2021

Object Detection and Pose Estimation from RGB and Depth Data for Real-time, Adaptive Robotic Grasping

In recent times, object detection and pose estimation have gained signif...
research
05/27/2022

A framework for robotic arm pose estimation and movement prediction based on deep and extreme learning models

Human-robot collaboration has gained a notable prominence in Industry 4....
research
02/24/2023

COVERED, CollabOratiVE Robot Environment Dataset for 3D Semantic segmentation

Safe human-robot collaboration (HRC) has recently gained a lot of intere...
research
06/07/2019

Ego-Pose Estimation and Forecasting as Real-Time PD Control

We propose the use of a proportional-derivative (PD) control based polic...
research
12/02/2022

ViTAL: Vision-Based Terrain-Aware Locomotion for Legged Robots

This work is on vision-based planning strategies for legged robots that ...
research
03/07/2023

Proactive Multi-Camera Collaboration For 3D Human Pose Estimation

This paper presents a multi-agent reinforcement learning (MARL) scheme f...

Please sign up or login with your details

Forgot password? Click here to reset