An adversarial learning framework for preserving users' anonymity in face-based emotion recognition

01/16/2020
by   Vansh Narula, et al.
0

Image and video-capturing technologies have permeated our every-day life. Such technologies can continuously monitor individuals' expressions in real-life settings, affording us new insights into their emotional states and transitions, thus paving the way to novel well-being and healthcare applications. Yet, due to the strong privacy concerns, the use of such technologies is met with strong skepticism, since current face-based emotion recognition systems relying on deep learning techniques tend to preserve substantial information related to the identity of the user, apart from the emotion-specific information. This paper proposes an adversarial learning framework which relies on a convolutional neural network (CNN) architecture trained through an iterative procedure for minimizing identity-specific information and maximizing emotion-dependent information. The proposed approach is evaluated through emotion classification and face identification metrics, and is compared against two CNNs, one trained solely for emotion recognition and the other trained solely for face identification. Experiments are performed using the Yale Face Dataset and Japanese Female Facial Expression Database. Results indicate that the proposed approach can learn a convolutional transformation for preserving emotion recognition accuracy and degrading face identity recognition, providing a foundation toward privacy-aware emotion recognition technologies.

READ FULL TEXT
research
09/06/2017

Group-level Emotion Recognition using Transfer Learning from Face Identification

In this paper, we describe our algorithmic approach, which was used for ...
research
12/11/2018

Face-Focused Cross-Stream Network for Deception Detection in Videos

Automated deception detection (ADD) from real-life videos is a challengi...
research
02/20/2023

Medical Face Masks and Emotion Recognition from the Body: Insights from a Deep Learning Perspective

The COVID-19 pandemic has undoubtedly changed the standards and affected...
research
02/12/2019

Improving Facial Emotion Recognition Systems Using Gradient and Laplacian Images

In this work, we have proposed several enhancements to improve the perfo...
research
03/31/2021

Privacy Enhanced Speech Emotion Communication using Deep Learning Aided Edge Computing

Speech emotion sensing in communication networks has a wide range of app...
research
06/29/2018

It All Matters: Reporting Accuracy, Inference Time and Power Consumption for Face Emotion Recognition on Embedded Systems

While several approaches to face emotion recognition task are proposed i...
research
08/29/2023

AI-Based Facial Emotion Recognition Solutions for Education: A Study of Teacher-User and Other Categories

Existing information on AI-based facial emotion recognition (FER) is not...

Please sign up or login with your details

Forgot password? Click here to reset