Efficient emotion recognition using hyperdimensional computing with combinatorial channel encoding and cellular automata

04/06/2021
by   Alisha Menon, et al.
0

In this paper, a hardware-optimized approach to emotion recognition based on the efficient brain-inspired hyperdimensional computing (HDC) paradigm is proposed. Emotion recognition provides valuable information for human-computer interactions, however the large number of input channels (>200) and modalities (>3) involved in emotion recognition are significantly expensive from a memory perspective. To address this, methods for memory reduction and optimization are proposed, including a novel approach that takes advantage of the combinatorial nature of the encoding process, and an elementary cellular automaton. HDC with early sensor fusion is implemented alongside the proposed techniques achieving two-class multi-modal classification accuracies of >76 for arousal on the multi-modal AMIGOS and DEAP datasets, almost always better than state of the art. The required vector storage is seamlessly reduced by 98 and the frequency of vector requests by at least 1/5. The results demonstrate the potential of efficient hyperdimensional computing for low-power, multi-channeled emotion recognition tasks.

READ FULL TEXT

page 1

page 9

research
09/09/2020

Multi-modal Attention for Speech Emotion Recognition

Emotion represents an essential aspect of human speech that is manifeste...
research
06/05/2019

A Sustainable Multi-modal Multi-layer Emotion-aware Service at the Edge

Limited by the computational capabilities and battery energy of terminal...
research
03/25/2022

EmoCaps: Emotion Capsule based Model for Conversational Emotion Recognition

Emotion recognition in conversation (ERC) aims to analyze the speaker's ...
research
09/20/2022

An Efficient End-to-End Transformer with Progressive Tri-modal Attention for Multi-modal Emotion Recognition

Recent works on multi-modal emotion recognition move towards end-to-end ...
research
06/02/2023

Multi-Modal Emotion Recognition for Enhanced Requirements Engineering: A Novel Approach

Requirements engineering (RE) plays a crucial role in developing softwar...
research
07/26/2022

A Two-Stage Efficient 3-D CNN Framework for EEG Based Emotion Recognition

This paper proposes a novel two-stage framework for emotion recognition ...
research
08/22/2021

Training and Profiling a Pediatric Emotion Recognition Classifier on Mobile Devices

Implementing automated emotion recognition on mobile devices could provi...

Please sign up or login with your details

Forgot password? Click here to reset