Efficient Dataflow Modeling of Peripheral Encoding in the Human Visual System

07/24/2021
by   Rachel Brown, et al.
0

Computer graphics seeks to deliver compelling images, generated within a computing budget, targeted at a specific display device, and ultimately viewed by an individual user. The foveated nature of human vision offers an opportunity to efficiently allocate computation and compression to appropriate areas of the viewer's visual field, especially with the rise of high resolution and wide field-of-view display devices. However, while the ongoing study of foveal vision is advanced, much less is known about how humans process imagery in the periphery of their vision – which comprises, at any given moment, the vast majority of the pixels in the image. We advance computational models for peripheral vision aimed toward their eventual use in computer graphics. In particular, we present a dataflow computational model of peripheral encoding that is more efficient than prior pooling - based methods and more compact than contrast sensitivity-based methods. Further, we account for the explicit encoding of "end stopped" features in the image, which was missing from previous methods. Finally, we evaluate our model in the context of perception of textures in the periphery. Our improved peripheral encoding may simplify development and testing of more sophisticated, complete models in more robust and realistic settings relevant to computer graphics.

READ FULL TEXT

page 1

page 3

page 6

page 7

page 10

page 12

page 13

page 15

research
04/29/2022

Perceptual Visibility Model for Temporal Contrast Changes in Periphery

Modeling perception is critical for many applications and developments i...
research
04/15/2021

Geometry encoding for numerical simulations

We present a notion of geometry encoding suitable for machine learning-b...
research
10/01/2007

The Theory of Unified Relativity for a Biovielectroluminescence Phenomenon via Fly's Visual and Imaging System

The elucidation upon fly's neuronal patterns as a link to computer graph...
research
10/05/2021

Metameric Varifocal Holography

Computer-Generated Holography (CGH) offers the potential for genuine, hi...
research
05/20/2022

Assessing visual acuity in visual prostheses through a virtual-reality system

Current visual implants still provide very low resolution and limited fi...
research
04/10/2018

Large Field and High Resolution: Detecting Needle in Haystack

The growing use of convolutional neural networks (CNN) for a broad range...
research
04/28/2021

A Perceptual Model for Eccentricity-dependent Spatio-temporal Flicker Fusion and its Applications to Foveated Graphics

Virtual and augmented reality (VR/AR) displays strive to provide a resol...

Please sign up or login with your details

Forgot password? Click here to reset