Bayesian optimization for automatic design of face stimuli

07/20/2020
by   Pedro F. da Costa, et al.
0

Investigating the cognitive and neural mechanisms involved with face processing is a fundamental task in modern neuroscience and psychology. To date, the majority of such studies have focused on the use of pre-selected stimuli. The absence of personalized stimuli presents a serious limitation as it fails to account for how each individual face processing system is tuned to cultural embeddings or how it is disrupted in disease. In this work, we propose a novel framework which combines generative adversarial networks (GANs) with Bayesian optimization to identify individual response patterns to many different faces. Formally, we employ Bayesian optimization to efficiently search the latent space of state-of-the-art GAN models, with the aim to automatically generate novel faces, to maximize an individual subject's response. We present results from a web-based proof-of-principle study, where participants rated images of themselves generated via performing Bayesian optimization over the latent space of a GAN. We show how the algorithm can efficiently locate an individual's optimal face while mapping out their response across different semantic transformations of a face; inter-individual analyses suggest how the approach can provide rich information about individual differences in face processing.

READ FULL TEXT

page 6

page 11

page 12

page 14

research
09/11/2020

Inverse mapping of face GANs

Generative adversarial networks (GANs) synthesize realistic images from ...
research
02/04/2022

Personalized visual encoding model construction with small data

Encoding models that predict brain response patterns to stimuli are one ...
research
06/16/2023

Human-in-the-Loop Optimization for Deep Stimulus Encoding in Visual Prostheses

Neuroprostheses show potential in restoring lost sensory function and en...
research
03/16/2022

Learning Representation for Bayesian Optimization with Collision-free Regularization

Bayesian optimization has been challenged by datasets with large-scale, ...
research
07/22/2021

Semantic Text-to-Face GAN -ST^2FG

Faces generated using generative adversarial networks (GANs) have reache...
research
06/15/2014

Neural tuning size is a key factor underlying holistic face processing

Faces are a class of visual stimuli with unique significance, for a vari...
research
08/31/2022

Bayesian Mixed Multidimensional Scaling for Auditory Processing

Speech sounds subtly differ on a multidimensional auditory-perceptual sp...

Please sign up or login with your details

Forgot password? Click here to reset