RealAnt: An Open-Source Low-Cost Quadruped for Research in Real-World Reinforcement Learning

11/05/2020
by   Rinu Boney, et al.
67

Current robot platforms available for research are either very expensive or unable to handle the abuse of exploratory controls in reinforcement learning. We develop RealAnt, a minimal low-cost physical version of the popular 'Ant' benchmark used in reinforcement learning. RealAnt costs only 410 in materials and can be assembled in less than an hour. We validate the platform with reinforcement learning experiments and provide baseline results on a set of benchmark tasks. We demonstrate that the TD3 algorithm can learn to walk the RealAnt from less than 45 minutes of experience. We also provide simulator versions of the robot (with the same dimensions, state-action spaces, and delayed noisy observations) in the MuJoCo and PyBullet simulators. We open-source hardware designs, supporting software, and baseline results for ease of reproducibility.

READ FULL TEXT

page 1

page 4

page 5

page 6

research
09/25/2019

ROBEL: Robotics Benchmarks for Learning with Low-Cost Robots

ROBEL is an open-source platform of cost-effective robots designed for r...
research
07/02/2022

DeltaZ: An Accessible Compliant Delta Robot Manipulator for Research and Education

This paper presents the DeltaZ robot, a centimeter-scale, low-cost, delt...
research
07/28/2022

RangL: A Reinforcement Learning Competition Platform

The RangL project hosted by The Alan Turing Institute aims to encourage ...
research
08/03/2020

Learning to Drive Small Scale Cars from Scratch

We consider the problem of learning to drive low-cost small scale cars u...
research
10/27/2022

Characterising the Robustness of Reinforcement Learning for Continuous Control using Disturbance Injection

In this study, we leverage the deliberate and systematic fault-injection...
research
08/08/2020

TriFinger: An Open-Source Robot for Learning Dexterity

Dexterous object manipulation remains an open problem in robotics, despi...
research
09/11/2018

KRATOS: An Open Source Hardware-Software Platform for Rapid Research in LPWANs

Long-range (LoRa) radio technologies have recently gained momentum in th...

Please sign up or login with your details

Forgot password? Click here to reset