Deep Learning-Based Perceptual Stimulus Encoder for Bionic Vision

by   Lucas Relic, et al.
The Regents of the University of California

Retinal implants have the potential to treat incurable blindness, yet the quality of the artificial vision they produce is still rudimentary. An outstanding challenge is identifying electrode activation patterns that lead to intelligible visual percepts (phosphenes). Here we propose a PSE based on CNN that is trained in an end-to-end fashion to predict the electrode activation patterns required to produce a desired visual percept. We demonstrate the effectiveness of the encoder on MNIST using a psychophysically validated phosphene model tailored to individual retinal implant users. The present work constitutes an essential first step towards improving the quality of the artificial vision provided by retinal implants.


page 1

page 3


A Deep Learning-based in silico Framework for Optimization on Retinal Prosthetic Stimulation

We propose a neural network-based framework to optimize the perceptions ...

Deep Learning–Based Scene Simplification for Bionic Vision

Retinal degenerative diseases cause profound visual impairment in more t...

A Hybrid Neural Autoencoder for Sensory Neuroprostheses and Its Applications in Bionic Vision

Sensory neuroprostheses are emerging as a promising technology to restor...

Machine Learning Method for Functional Assessment of Retinal Models

Challenges in the field of retinal prostheses motivate the development o...

Vis-CRF, A Classical Receptive Field Model for VISION

Over the last decade, a variety of new neurophysiological experiments ha...

Gaze-Contingent Retinal Speckle Suppression for Perceptually-Matched Foveated Holographic Displays

Computer-generated holographic (CGH) displays show great potential and a...

Bioplausible multiscale filtering in retino-cortical processing as a mechanism in perceptual grouping

Why does our visual system fail to reconstruct reality, when we look at ...

Please sign up or login with your details

Forgot password? Click here to reset