Exploration of Reinforcement Learning for Event Camera using Car-like Robots

04/02/2020
by   Riku Arakawa, et al.
0

We demonstrate the first reinforcement-learning application for robots equipped with an event camera. Because of the considerably lower latency of the event camera, it is possible to achieve much faster control of robots compared with the existing vision-based reinforcement-learning applications using standard cameras. To handle a stream of events for reinforcement learning, we introduced an image-like feature and demonstrated the feasibility of training an agent in a simulator for two tasks: fast collision avoidance and obstacle tracking. Finally, we set up a robot with an event camera in the real world and then transferred the agent trained in the simulator, resulting in successful fast avoidance of randomly thrown objects. Incorporating event camera into reinforcement learning opens new possibilities for various robotics applications that require swift control, such as autonomous vehicles and drones, through end-to-end learning approaches.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 3

page 5

03/08/2021

Vision-Based Mobile Robotics Obstacle Avoidance With Deep Reinforcement Learning

Obstacle avoidance is a fundamental and challenging problem for autonomo...
10/29/2020

Night vision obstacle detection and avoidance based on Bio-Inspired Vision Sensors

Moving towards autonomy, unmanned vehicles rely heavily on state-of-the-...
08/17/2020

Model-Reference Reinforcement Learning for Collision-Free Tracking Control of Autonomous Surface Vehicles

This paper presents a novel model-reference reinforcement learning algor...
03/01/2021

Representation Learning for Event-based Visuomotor Policies

Event-based cameras are dynamic vision sensors that can provide asynchro...
02/25/2020

Learning Machines from Simulation to Real World

Learning Machines is developing a flexible, cross-industry, advanced ana...
02/25/2021

FAITH: Fast iterative half-plane focus of expansion estimation using event-based optic flow

Course estimation is a key component for the development of autonomous n...
10/11/2021

Autonomous Racing using a Hybrid Imitation-Reinforcement Learning Architecture

In this work, we present a rigorous end-to-end control strategy for auto...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.