REPLAB: A Reproducible Low-Cost Arm Benchmark Platform for Robotic Learning

05/17/2019
by   Brian Yang, et al.
0

Standardized evaluation measures have aided in the progress of machine learning approaches in disciplines such as computer vision and machine translation. In this paper, we make the case that robotic learning would also benefit from benchmarking, and present the "REPLAB" platform for benchmarking vision-based manipulation tasks. REPLAB is a reproducible and self-contained hardware stack (robot arm, camera, and workspace) that costs about 2000 USD, occupies a cuboid of size 70x40x60 cm, and permits full assembly within a few hours. Through this low-cost, compact design, REPLAB aims to drive wide participation by lowering the barrier to entry into robotics and to enable easy scaling to many robots. We envision REPLAB as a framework for reproducible research across manipulation tasks, and as a step in this direction, we define a template for a grasping benchmark consisting of a task definition, evaluation protocol, performance measures, and a dataset of 92k grasp attempts. We implement, evaluate, and analyze several previously proposed grasping approaches to establish baselines for this benchmark. Finally, we also implement and evaluate a deep reinforcement learning approach for 3D reaching tasks on our REPLAB platform. Project page with assembly instructions, code, and videos: https://goo.gl/5F9dP4.

READ FULL TEXT

page 1

page 4

page 6

research
09/25/2019

ROBEL: Robotics Benchmarks for Learning with Low-Cost Robots

ROBEL is an open-source platform of cost-effective robots designed for r...
research
06/27/2018

QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation

In this paper, we study the problem of learning vision-based dynamic man...
research
09/12/2023

LEAP Hand: Low-Cost, Efficient, and Anthropomorphic Hand for Robot Learning

Dexterous manipulation has been a long-standing challenge in robotics. W...
research
02/28/2018

Deep Reinforcement Learning for Vision-Based Robotic Grasping: A Simulated Comparative Evaluation of Off-Policy Methods

In this paper, we explore deep reinforcement learning algorithms for vis...
research
05/20/2021

Towards a Sample Efficient Reinforcement Learning Pipeline for Vision Based Robotics

Deep Reinforcement learning holds the guarantee of empowering self-rulin...
research
05/16/2023

RAMP: A Benchmark for Evaluating Robotic Assembly Manipulation and Planning

We introduce RAMP, an open-source robotics benchmark inspired by real-wo...
research
06/08/2023

Jigsaw-based Benchmarking for Learning Robotic Manipulation

Benchmarking provides experimental evidence of the scientific baseline t...

Please sign up or login with your details

Forgot password? Click here to reset