Affective Computing for Large-Scale Heterogeneous Multimedia Data: A Survey

by   Sicheng Zhao, et al.
University of Southern California
Rensselaer Polytechnic Institute

The wide popularity of digital photography and social networks has generated a rapidly growing volume of multimedia data (i.e., image, music, and video), resulting in a great demand for managing, retrieving, and understanding these data. Affective computing (AC) of these data can help to understand human behaviors and enable wide applications. In this article, we survey the state-of-the-art AC technologies comprehensively for large-scale heterogeneous multimedia data. We begin this survey by introducing the typical emotion representation models from psychology that are widely employed in AC. We briefly describe the available datasets for evaluating AC algorithms. We then summarize and compare the representative methods on AC of different multimedia types, i.e., images, music, videos, and multimodal data, with the focus on both handcrafted features-based methods and deep learning methods. Finally, we discuss some challenges and future directions for multimedia affective computing.


A Survey of Multimedia Technologies and Robust Algorithms

Multimedia technologies are now more practical and deployable in real li...

Multimedia Technology Applications and Algorithms: A Survey

Multimedia related research and development has evolved rapidly in the l...

Leveraging Large-scale Multimedia Datasets to Refine Content Moderation Models

The sheer volume of online user-generated content has rendered content m...

Nemoz - A Distributed Framework for Collaborative Media Organization

Multimedia applications have received quite some interest. Embedding the...

Learning in High-Dimensional Multimedia Data: The State of the Art

During the last decade, the deluge of multimedia data has impacted a wid...

Novel Metaknowledge-based Processing Technique for Multimedia Big Data clustering challenges

Past research has challenged us with the task of showing relational patt...

Please sign up or login with your details

Forgot password? Click here to reset