SeLiNet: Sentiment enriched Lightweight Network for Emotion Recognition in Images

07/06/2023

∙

by   Tuneer Khargonkar, et al.

∙

0

∙

share

In this paper, we propose a sentiment-enriched lightweight network SeLiNet and an end-to-end on-device pipeline for contextual emotion recognition in images. SeLiNet model consists of body feature extractor, image aesthetics feature extractor, and learning-based fusion network which jointly estimates discrete emotion and human sentiments tasks. On the EMOTIC dataset, the proposed approach achieves an Average Precision (AP) score of 27.17 in comparison to the baseline AP score of 27.38 while reducing the model size by >85 model size by >93