Fashion Recommendation and Compatibility Prediction Using Relational Network

by   Maryam Moosaei, et al.

Fashion is an inherently visual concept and computer vision and artificial intelligence (AI) are playing an increasingly important role in shaping the future of this domain. Many research has been done on recommending fashion products based on the learned user preferences. However, in addition to recommending single items, AI can also help users create stylish outfits from items they already have, or purchase additional items that go well with their current wardrobe. Compatibility is the key factor in creating stylish outfits from single items. Previous studies have mostly focused on modeling pair-wise compatibility. There are a few approaches that consider an entire outfit, but these approaches have limitations such as requiring rich semantic information, category labels, and fixed order of items. Thus, they fail to effectively determine compatibility when such information is not available. In this work, we adopt a Relation Network (RN) to develop new compatibility learning models, Fashion RN and FashionRN-VSE, that addresses the limitations of existing approaches. FashionRN learns the compatibility of an entire outfit, with an arbitrary number of items, in an arbitrary order. We evaluated our model using a large dataset of 49,740 outfits that we collected from Polyvore website. Quantitatively, our experimental results demonstrate state of the art performance compared with alternative methods in the literature in both compatibility prediction and fill-in-the-blank test. Qualitatively, we also show that the item embedding learned by FashionRN indicate the compatibility among fashion items.


page 1

page 9


Learning Tuple Compatibility for Conditional OutfitRecommendation

Outfit recommendation requires the answers of some challenging outfit co...

Context-Aware Visual Compatibility Prediction

How do we determine whether two or more clothing items are compatible or...

Fashion Outfit Complementary Item Retrieval

Complementary fashion item recommendation is critical for fashion outfit...

Learning Compatibility Across Categories for Heterogeneous Item Recommendation

Identifying relationships between items is a key task of an online recom...

Creating Capsule Wardrobes from Fashion Images

We propose to automatically create capsule wardrobes. Given an inventory...

Please sign up or login with your details

Forgot password? Click here to reset