Exploration of Reinforcement Learning for Event Camera using Car-like Robots

by   Riku Arakawa, et al.

We demonstrate the first reinforcement-learning application for robots equipped with an event camera. Because of the considerably lower latency of the event camera, it is possible to achieve much faster control of robots compared with the existing vision-based reinforcement-learning applications using standard cameras. To handle a stream of events for reinforcement learning, we introduced an image-like feature and demonstrated the feasibility of training an agent in a simulator for two tasks: fast collision avoidance and obstacle tracking. Finally, we set up a robot with an event camera in the real world and then transferred the agent trained in the simulator, resulting in successful fast avoidance of randomly thrown objects. Incorporating event camera into reinforcement learning opens new possibilities for various robotics applications that require swift control, such as autonomous vehicles and drones, through end-to-end learning approaches.



There are no comments yet.


page 1

page 3

page 5


Vision-Based Mobile Robotics Obstacle Avoidance With Deep Reinforcement Learning

Obstacle avoidance is a fundamental and challenging problem for autonomo...

Night vision obstacle detection and avoidance based on Bio-Inspired Vision Sensors

Moving towards autonomy, unmanned vehicles rely heavily on state-of-the-...

Model-Reference Reinforcement Learning for Collision-Free Tracking Control of Autonomous Surface Vehicles

This paper presents a novel model-reference reinforcement learning algor...

Representation Learning for Event-based Visuomotor Policies

Event-based cameras are dynamic vision sensors that can provide asynchro...

Learning Machines from Simulation to Real World

Learning Machines is developing a flexible, cross-industry, advanced ana...

FAITH: Fast iterative half-plane focus of expansion estimation using event-based optic flow

Course estimation is a key component for the development of autonomous n...

Autonomous Racing using a Hybrid Imitation-Reinforcement Learning Architecture

In this work, we present a rigorous end-to-end control strategy for auto...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.