Mining Latent Structures for Multimedia Recommendation

04/19/2021
by   Jinghao Zhang, et al.
9

Multimedia content is of predominance in the modern Web era. Investigating how users interact with multimodal items is a continuing concern within the rapid development of recommender systems. The majority of previous work focuses on modeling user-item interactions with multimodal features included as side information. However, this scheme is not well-designed for multimedia recommendation. Specifically, only collaborative item-item relationships are implicitly modeled through high-order item-user-item relations. Considering that items are associated with rich contents in multiple modalities, we argue that the latent semantic item-item structures underlying these multimodal contents could be beneficial for learning better item representations and further boosting recommendation. To this end, we propose a LATent sTructure mining method for multImodal reCommEndation, which we term LATTICE for brevity. To be specific, in the proposed LATTICE model, we devise a novel modality-aware structure learning layer, which learns item-item structures for each modality and aggregates multiple modalities to obtain latent item graphs. Based on the learned latent graphs, we perform graph convolutions to explicitly inject high-order item affinities into item representations. These enriched item representations can then be plugged into existing collaborative filtering methods to make more accurate recommendations. Extensive experiments on three real-world datasets demonstrate the superiority of our method over state-of-the-art multimedia recommendation methods and validate the efficacy of mining latent item-item relationships from multimodal features.

READ FULL TEXT
research
11/13/2022

A Tale of Two Graphs: Freezing and Denoising Graph Structures for Multimodal Recommendation

Multimodal recommender systems utilizing multimodal features (e.g. image...
research
01/28/2023

Enhancing Dyadic Relations with Homogeneous Graphs for Multimodal Recommendation

User interaction data in recommender systems is a form of dyadic relatio...
research
08/14/2023

MM-GEF: Multi-modal representation meet collaborative filtering

In modern e-commerce, item content features in various modalities offer ...
research
06/01/2023

A Multi-Modal Latent-Features based Service Recommendation System for the Social Internet of Things

The Social Internet of Things (SIoT), is revolutionizing how we interact...
research
09/11/2023

Formalizing Multimedia Recommendation through Multimodal Deep Learning

Recommender systems (RSs) offer personalized navigation experiences on o...
research
05/25/2015

Clustering via Content-Augmented Stochastic Blockmodels

Much of the data being created on the web contains interactions between ...
research
08/07/2023

Multi-View Graph Convolutional Network for Multimedia Recommendation

Multimedia recommendation has received much attention in recent years. I...

Please sign up or login with your details

Forgot password? Click here to reset