Learning Diverse Fashion Collocation by Neural Graph Filtering

by   Xin Liu, et al.

Fashion recommendation systems are highly desired by customers to find visually-collocated fashion items, such as clothes, shoes, bags, etc. While existing methods demonstrate promising results, they remain lacking in flexibility and diversity, e.g. assuming a fixed number of items or favoring safe but boring recommendations. In this paper, we propose a novel fashion collocation framework, Neural Graph Filtering, that models a flexible set of fashion items via a graph neural network. Specifically, we consider the visual embeddings of each garment as a node in the graph, and describe the inter-garment relationship as the edge between nodes. By applying symmetric operations on the edge vectors, this framework allows varying numbers of inputs/outputs and is invariant to their ordering. We further include a style classifier augmented with focal loss to enable the collocation of significantly diverse styles, which are inherently imbalanced in the training set. To facilitate a comprehensive study on diverse fashion collocation, we reorganize Amazon Fashion dataset with carefully designed evaluation protocols. We evaluate the proposed approach on three popular benchmarks, the Polyvore dataset, the Polyvore-D dataset, and our reorganized Amazon Fashion dataset. Extensive experimental results show that our approach significantly outperforms the state-of-the-art methods with over 10 metric on the established tasks. More importantly, 82.5 our diverse-style recommendations over other alternatives in a real-world perception study.


page 1

page 3

page 7

page 11

page 12

page 13

page 14


Style2Vec: Representation Learning for Fashion Items from Style Sets

With the rapid growth of online fashion market, demand for effective fas...

Learning Tuple Compatibility for Conditional OutfitRecommendation

Outfit recommendation requires the answers of some challenging outfit co...

Dressing as a Whole: Outfit Compatibility Learning Based on Node-wise Graph Neural Networks

With the rapid development of fashion market, the customers' demands of ...

Addressing the Cold-Start Problem in Outfit Recommendation Using Visual Preference Modelling

With the global transformation of the fashion industry and a rise in the...

Garment Recommendation with Memory Augmented Neural Networks

Fashion plays a pivotal role in society. Combining garments appropriatel...

Marching with the Pink Parade: Evaluating Visual Search Recommendations for Non-binary Clothing Items

Fashion, a highly subjective topic is interpreted differently by all ind...

Dress Well via Fashion Cognitive Learning

Fashion compatibility models enable online retailers to easily obtain a ...

Please sign up or login with your details

Forgot password? Click here to reset