Learning Fashion Compatibility with Bidirectional LSTMs

07/18/2017
by   Xintong Han, et al.
0

The ubiquity of online fashion shopping demands effective recommendation services for customers. In this paper, we study two types of fashion recommendation: (i) suggesting an item that matches existing components in a set to form a stylish outfit (a collection of fashion items), and (ii) generating an outfit with multimodal (images/text) specifications from a user. To this end, we propose to jointly learn a visual-semantic embedding and the compatibility relationships among fashion items in an end-to-end fashion. More specifically, we consider a fashion outfit to be a sequence (usually from top to bottom and then accessories) and each item in the outfit as a time step. Given the fashion items in an outfit, we train a bidirectional LSTM (Bi-LSTM) model to sequentially predict the next item conditioned on previous ones to learn their compatibility relationships. Further, we learn a visual-semantic space by regressing image features to their semantic representations aiming to inject attribute and category information as a regularization for training the LSTM. The trained network can not only perform the aforementioned recommendations effectively but also predict the compatibility of a given outfit. We conduct extensive experiments on our newly collected Polyvore dataset, and the results provide strong qualitative and quantitative evidence that our framework outperforms alternative methods.

READ FULL TEXT

page 1

page 2

page 3

page 6

page 7

page 8

research
08/01/2022

Dress Well via Fashion Cognitive Learning

Fashion compatibility models enable online retailers to easily obtain a ...
research
02/21/2019

Dressing as a Whole: Outfit Compatibility Learning Based on Node-wise Graph Neural Networks

With the rapid development of fashion market, the customers' demands of ...
research
03/25/2018

Learning Type-Aware Embeddings for Fashion Compatibility

Outfits in online fashion data are composed of items of many different t...
research
08/04/2020

PAI-BPR: Personalized Outfit Recommendation Scheme with Attribute-wise Interpretability

Fashion is an important part of human experience. Events such as intervi...
research
12/25/2018

TransNFCM: Translation-Based Neural Fashion Compatibility Modeling

Identifying mix-and-match relationships between fashion items is an urge...
research
05/01/2019

Learning fashion compatibility across apparel categories for outfit recommendation

This paper addresses the problem of generating recommendations for compl...
research
08/18/2020

Learning Tuple Compatibility for Conditional OutfitRecommendation

Outfit recommendation requires the answers of some challenging outfit co...

Please sign up or login with your details

Forgot password? Click here to reset