Learning via social awareness: improving sketch representations with facial feedback

02/13/2018
by   Natasha Jaques, et al.
0

In the quest towards general artificial intelligence (AI), researchers have explored developing loss functions that act as intrinsic motivators in the absence of external rewards. This paper argues that such research has overlooked an important and useful intrinsic motivator: social interaction. We posit that making an AI agent aware of implicit social feedback from humans can allow for faster learning of more generalizable and useful representations, and could potentially impact AI safety. We collect social feedback in the form of facial expression reactions to samples from Sketch RNN, an LSTM-based variational autoencoder (VAE) designed to produce sketch drawings. We use a Latent Constraints GAN (LC-GAN) to learn from the facial feedback of a small group of viewers, and then show in an independent evaluation with 76 users that this model produced sketches that lead to significantly more positive facial expressions. Thus, we establish that implicit social feedback can improve the output of a deep learning model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/23/2020

Facial Feedback for Reinforcement Learning: A Case Study and Offline Analysis Using the TAMER Framework

Interactive reinforcement learning provides a way for agents to learn to...
research
03/21/2021

Responsible AI: Gender bias assessment in emotion recognition

Rapid development of artificial intelligence (AI) systems amplify many c...
research
07/28/2021

"Excavating AI" Re-excavated: Debunking a Fallacious Account of the JAFFE Dataset

Twenty-five years ago, my colleagues Miyuki Kamachi and Jiro Gyoba and I...
research
09/28/2020

The EMPATHIC Framework for Task Learning from Implicit Human Feedback

Reactions such as gestures, facial expressions, and vocalizations are an...
research
04/16/2021

I Only Have Eyes for You: The Impact of Masks On Convolutional-Based Facial Expression Recognition

The current COVID-19 pandemic has shown us that we are still facing unpr...
research
01/27/2018

Interactive Generative Adversarial Networks for Facial Expression Generation in Dyadic Interactions

A social interaction is a social exchange between two or more individual...
research
09/21/2021

SalienTrack: providing salient information for semi-automated self-tracking feedback with model explanations

Self-tracking can improve people's awareness of their unhealthy behavior...

Please sign up or login with your details

Forgot password? Click here to reset