SCENEREPLICA: Benchmarking Real-World Robot Manipulation by Creating Reproducible Scenes

06/27/2023
by   Ninad Khargonkar, et al.
0

We present a new reproducible benchmark for evaluating robot manipulation in the real world, specifically focusing on pick-and-place. Our benchmark uses the YCB objects, a commonly used dataset in the robotics community, to ensure that our results are comparable to other studies. Additionally, the benchmark is designed to be easily reproducible in the real world, making it accessible to researchers and practitioners. We also provide our experimental results and analyzes for model-based and model-free 6D robotic grasping on the benchmark, where representative algorithms are evaluated for object perception, grasping planning, and motion planning. We believe that our benchmark will be a valuable tool for advancing the field of robot manipulation. By providing a standardized evaluation framework, researchers can more easily compare different techniques and algorithms, leading to faster progress in developing robot manipulation methods.

READ FULL TEXT

page 4

page 5

page 6

page 8

page 12

research
12/13/2021

MotionBenchMaker: A Tool to Generate and Benchmark Motion Planning Datasets

Recently, there has been a wealth of development in motion planning for ...
research
01/31/2022

PokeRRT: Poking as a Skill and Failure Recovery Tactic for Planar Non-Prehensile Manipulation

In this work, we introduce PokeRRT, a novel motion planning algorithm th...
research
05/27/2022

BURG-Toolkit: Robot Grasping Experiments in Simulation and the Real World

This paper presents BURG-Toolkit, a set of open-source tools for Benchma...
research
05/16/2023

RAMP: A Benchmark for Evaluating Robotic Assembly Manipulation and Planning

We introduce RAMP, an open-source robotics benchmark inspired by real-wo...
research
11/05/2019

Benchmarking Simulated Robotic Manipulation through a Real World Dataset

We present a benchmark to facilitate simulated manipulation; an attempt ...
research
04/23/2021

OCRTOC: A Cloud-Based Competition and Benchmark for Robotic Grasping and Manipulation

In this paper, we propose a cloud-based benchmark for robotic grasping a...
research
06/08/2023

Jigsaw-based Benchmarking for Learning Robotic Manipulation

Benchmarking provides experimental evidence of the scientific baseline t...

Please sign up or login with your details

Forgot password? Click here to reset