A Comprehensive Survey on Multimodal Recommender Systems: Taxonomy, Evaluation, and Future Directions

02/09/2023
by   Hongyu Zhou, et al.
0

Recommendation systems have become popular and effective tools to help users discover their interesting items by modeling the user preference and item property based on implicit interactions (e.g., purchasing and clicking). Humans perceive the world by processing the modality signals (e.g., audio, text and image), which inspired researchers to build a recommender system that can understand and interpret data from different modalities. Those models could capture the hidden relations between different modalities and possibly recover the complementary information which can not be captured by a uni-modal approach and implicit interactions. The goal of this survey is to provide a comprehensive review of the recent research efforts on the multimodal recommendation. Specifically, it shows a clear pipeline with commonly used techniques in each step and classifies the models by the methods used. Additionally, a code framework has been designed that helps researchers new in this area to understand the principles and techniques, and easily runs the SOTA models. Our framework is located at: https://github.com/enoche/MMRec

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/10/2022

Disentangled Multimodal Representation Learning for Recommendation

Many multimodal recommender systems have been proposed to exploit the ri...
research
09/19/2019

Research Commentary on Recommendations with Side Information: A Survey and Research Directions

Recommender systems have become an essential tool to help resolve the in...
research
09/20/2021

Recommender systems based on graph embedding techniques: A comprehensive review

Recommender systems, a pivotal tool to alleviate the information overloa...
research
01/23/2021

Advances and Challenges in Conversational Recommender Systems: A Survey

Recommender systems exploit interaction history to estimate user prefere...
research
12/08/2022

A Survey of Graph Neural Networks for Social Recommender Systems

Social recommender systems (SocialRS) simultaneously leverage user-to-it...
research
04/02/2023

A Framework and Call to Action for the Future Development of EMG-Based Input in HCI

Electromyography (EMG) has been explored as an HCI input modality follow...
research
03/03/2021

Elliot: a Comprehensive and Rigorous Framework for Reproducible Recommender Systems Evaluation

Recommender Systems have shown to be an effective way to alleviate the o...

Please sign up or login with your details

Forgot password? Click here to reset