Towards an Intelligent Microscope: adaptively learned illumination for optimal sample classification

10/22/2019
by   Amey Chaware, et al.
0

Recent machine learning techniques have dramatically changed how we process digital images. However, the way in which we capture images is still largely driven by human intuition and experience. This restriction is in part due to the many available degrees of freedom that alter the image acquisition process (lens focus, exposure, filtering, etc). Here we focus on one such degree of freedom - illumination within a microscope - which can drastically alter information captured by the image sensor. We present a reinforcement learning system that adaptively explores optimal patterns to illuminate specimens for immediate classification. The agent uses a recurrent latent space to encode a large set of variably-illuminated samples and illumination patterns. We train our agent using a reward that balances classification confidence with image acquisition cost. By synthesizing knowledge over multiple snapshots, the agent can classify on the basis of all previous images with higher accuracy than from naively illuminated images, thus demonstrating a smarter way to physically capture task-specific information.

READ FULL TEXT
research
06/04/2018

Design of optimal illumination patterns in single-pixel imaging using image dictionaries

Single-pixel imaging (SPI) has a major drawback that the huge number of ...
research
04/09/2020

Physics-enhanced machine learning for virtual fluorescence microscopy

This paper introduces a supervised deep-learning network that jointly op...
research
02/13/2020

On the Sensory Commutativity of Action Sequences for Embodied Agents

We study perception in the scenario of an embodied agent equipped with f...
research
08/04/2023

Deep Reinforcement Learning for Autonomous Spacecraft Inspection using Illumination

This paper investigates the problem of on-orbit spacecraft inspection us...
research
06/03/2022

Dynamic Structured Illumination Microscopy with a Neural Space-time Model

Structured illumination microscopy (SIM) reconstructs a super-resolved i...
research
07/24/2019

Learning abstract perceptual notions: the example of space

Humans are extremely swift learners. We are able to grasp highly abstrac...
research
05/30/2018

Context Exploitation using Hierarchical Bayesian Models

We consider the problem of how to improve automatic target recognition b...

Please sign up or login with your details

Forgot password? Click here to reset