Playing optical tweezers with deep reinforcement learning: in virtual, physical and augmented environments

11/05/2020
by   Matthew Praeger, et al.
12

Reinforcement learning was carried out in a simulated environment to learn continuous velocity control over multiple motor axes. This was then applied to a real-world optical tweezers experiment with the objective of moving a laser-trapped microsphere to a target location whilst avoiding collisions with other free-moving microspheres. The concept of training a neural network in a virtual environment has significant potential in the application of machine learning for experimental optimization and control, as the neural network can discover optimal methods for problem solving without the risk of damage to equipment, and at a speed not limited by movement in the physical environment. As the neural network treats both virtual and physical environments equivalently, we show that the network can also be applied to an augmented environment, where a virtual environment is combined with the physical environment. This technique may have the potential to unlock capabilities associated with mixed and augmented reality, such as enforcing safety limits for machine motion or as a method of inputting observations from additional sensors.

READ FULL TEXT

page 3

page 4

page 5

page 7

page 8

page 9

research
11/21/2020

HDR Environment Map Estimation for Real-Time Augmented Reality

We present a method to estimate an HDR environment map from a narrow fie...
research
04/28/2022

Virtual and Augmented Reality-Based Assistive Interfaces for Upper-limb Prosthesis Control and Rehabilitation

Functional upper-limb prosthetic training can improve users performance ...
research
05/25/2018

Virtual-Taobao: Virtualizing Real-world Online Retail Environment for Reinforcement Learning

Applying reinforcement learning in physical-world tasks is extremely cha...
research
09/20/2019

Redirection Controller Using Reinforcement Learning

In the redirected walking fields, there is a high demand for planning th...
research
07/06/2020

Augment Yourself: Mixed Reality Self-Augmentation Using Optical See-through Head-mounted Displays and Physical Mirrors

Optical see-though head-mounted displays (OST HMDs) are one of the key t...
research
07/09/2021

Aligning an optical interferometer with beam divergence control and continuous action space

Reinforcement learning is finding its way to real-world problem applicat...

Please sign up or login with your details

Forgot password? Click here to reset