CuratorNet: Visually-aware Recommendation of Art Images

09/09/2020
by   Pablo Messina, et al.
0

Although there are several visually-aware recommendation models in domains like fashion or even movies, the art domain lacks thesame level of research attention, despite the recent growth of the online artwork market. To reduce this gap, in this article we introduceCuratorNet, a neural network architecture for visually-aware recommendation of art images. CuratorNet is designed at the core withthe goal of maximizing generalization: the network has a fixed set of parameters that only need to be trained once, and thereafter themodel is able to generalize to new users or items never seen before, without further training. This is achieved by leveraging visualcontent: items are mapped to item vectors through visual embeddings, and users are mapped to user vectors by aggregating the visualcontent of items they have consumed. Besides the model architecture, we also introduce novel triplet sampling strategies to build atraining set for rank learning in the art domain, resulting in more effective learning than naive random sampling. With an evaluationover a real-world dataset of physical paintings, we show that CuratorNet achieves the best performance among several baselines,including the state-of-the-art model VBPR. CuratorNet is motivated and evaluated in the art domain, but its architecture and trainingscheme could be adapted to recommend images in other areas

READ FULL TEXT
research
06/26/2018

Visually-Aware Personalized Recommendation using Interpretable Image Representations

Visually-aware recommender systems use visual signals present in the und...
research
11/07/2017

Visually-Aware Fashion Recommendation and Design with Generative Image Models

Building effective recommender systems for domains like fashion is chall...
research
11/28/2022

Learning Recommendations from User Actions in the Item-poor Insurance Domain

While personalised recommendations are successful in domains like retail...
research
03/30/2022

Recommendation of Compatible Outfits Conditioned on Style

Recommendation in the fashion domain has seen a recent surge in research...
research
09/17/2019

Variational Bayesian Context-aware Representation for Grocery Recommendation

Grocery recommendation is an important recommendation use-case, which ai...
research
09/10/2018

A Correlation Maximization Approach for Cross Domain Co-Embeddings

Although modern recommendation systems can exploit the structure in user...
research
06/01/2020

A Neural Network Model of Lexical Competition during Infant Spoken Word Recognition

Visual world studies show that upon hearing a word in a target-absent vi...

Please sign up or login with your details

Forgot password? Click here to reset