Emotion recognition using a glasses-type wearable device via multi-channel facial responses

05/14/2019
by   Jangho Kwon, et al.
0

We present a glasses type wearable device to detect emotions from a human face in an unobtrusive manner. The device is designed to gather multi channel responses from the user face naturally and continuously while the user is wearing it. The multi channel responses include physiological responses of the facial muscles and organs based on electrodermal activity (EDA) and photoplethysmogram. We conducted experiments to determine the optimal positions of EDA sensors on the wearable device because EDA signal quality is very sensitive to the sensing position. In addition to the physiological data, the device can capture the image region representing local facial expressions around the left eye via a built in camera. In this study, we developed and validated an algorithm to recognize emotions using multi channel responses obtained from the device. The results show that the emotion recognition algorithm using only local facial expressions has an accuracy of 78 percent at classifying emotions. Using multi channel data, this accuracy was increased by 10.1 percent. This unobtrusive wearable system with facial multi channel responses is very useful for monitoring a user emotions in daily life, which has a huge potential for use in the healthcare industry.

READ FULL TEXT

page 2

page 3

page 10

page 11

research
08/22/2023

WEARS: Wearable Emotion AI with Real-time Sensor data

Emotion prediction is the field of study to understand human emotions. E...
research
05/17/2020

Impact of multiple modalities on emotion recognition: investigation into 3d facial landmarks, action units, and physiological data

To fully understand the complexities of human emotion, the integration o...
research
11/12/2018

Angry or Climbing Stairs? Towards Physiological Emotion Recognition in the Wild

Inferring emotions from physiological signals has gained much traction i...
research
08/29/2017

Gender and Emotion Recognition with Implicit User Signals

We examine the utility of implicit user behavioral signals captured usin...
research
02/28/2021

Emotion recognition techniques with rule based and machine learning approaches

Emotion recognition using digital image processing is a multifarious tas...
research
05/05/2021

Does the Goal Matter? Emotion Recognition Tasks Can Change the Social Value of Facial Mimicry towards Artificial Agents

In this paper, we present a study aimed at understanding whether the emb...
research
04/11/2023

Wearable multi-color RAPD screening device

In this work, we developed a wearable, head-mounted device that automati...

Please sign up or login with your details

Forgot password? Click here to reset