Multi-modal Emotion Estimation for in-the-wild Videos

03/24/2022
by   Liyu Meng, et al.
0

In this paper, we briefly introduce our submission to the Valence-Arousal Estimation Challenge of the 3rd Affective Behavior Analysis in-the-wild (ABAW) competition. Our method utilizes the multi-modal information, i.e., the visual and audio information, and employs a temporal encoder to model the temporal context in the videos. Besides, a smooth processor is applied to get more reasonable predictions, and a model ensemble strategy is used to improve the performance of our proposed method. The experiment results show that our method achieves 65.55 set of the Aff-Wild2 dataset, which prove the effectiveness of our proposed method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/20/2023

Facial Affective Analysis based on MAE and Multi-modal Information for 5th ABAW Competition

Human affective behavior analysis focuses on analyzing human expressions...
research
03/17/2023

Multi-modal Expression Recognition with Ensemble Method

This paper presents our submission to the Expression Classification Chal...
research
02/07/2020

M^3T: Multi-Modal Continuous Valence-Arousal Estimation in the Wild

This report describes a multi-modal multi-task (M^3T) approach underlyin...
research
02/26/2020

Multi-Modal Continuous Valence And Arousal Prediction in the Wild Using Deep 3D Features and Sequence Modeling

Continuous affect prediction in the wild is a very interesting problem a...
research
07/08/2021

Technical Report for Valence-Arousal Estimation in ABAW2 Challenge

In this work, we describe our method for tackling the valence-arousal es...
research
02/09/2020

Two-Stream Aural-Visual Affect Analysis in the Wild

In this work we introduce our submission to the Affective Behavior Analy...
research
09/25/2022

Multi-modal Segment Assemblage Network for Ad Video Editing with Importance-Coherence Reward

Advertisement video editing aims to automatically edit advertising video...

Please sign up or login with your details

Forgot password? Click here to reset