Robust-MSA: Understanding the Impact of Modality Noise on Multimodal Sentiment Analysis

11/24/2022
by   Huisheng Mao, et al.
0

Improving model robustness against potential modality noise, as an essential step for adapting multimodal models to real-world applications, has received increasing attention among researchers. For Multimodal Sentiment Analysis (MSA), there is also a debate on whether multimodal models are more effective against noisy features than unimodal ones. Stressing on intuitive illustration and in-depth analysis of these concerns, we present Robust-MSA, an interactive platform that visualizes the impact of modality noise as well as simple defence methods to help researchers know better about how their models perform with imperfect real-world data.

READ FULL TEXT
research
05/30/2022

Analyzing Modality Robustness in Multimodal Sentiment Analysis

Building robust multimodal models are crucial for achieving reliable dep...
research
11/11/2021

Trustworthy Multimodal Regression with Mixture of Normal-inverse Gamma Distributions

Multimodal regression is a fundamental task, which integrates the inform...
research
01/22/2023

Self-driving Multimodal Studies at User Facilities

Multimodal characterization is commonly required for understanding mater...
research
03/23/2022

M-SENA: An Integrated Platform for Multimodal Sentiment Analysis

M-SENA is an open-sourced platform for Multimodal Sentiment Analysis. It...
research
05/07/2023

Interpretable multimodal sentiment analysis based on textual modality descriptions by using large-scale language models

Multimodal sentiment analysis is an important area for understanding the...
research
03/01/2022

Sentiment Word Aware Multimodal Refinement for Multimodal Sentiment Analysis with ASR Errors

Multimodal sentiment analysis has attracted increasing attention and lot...
research
03/20/2023

Multimodal Shannon Game with Images

The Shannon game has long been used as a thought experiment in linguisti...

Please sign up or login with your details

Forgot password? Click here to reset