Self-supervised Visual Attribute Learning for Fashion Compatibility

08/01/2020
by   Donghyun Kim, et al.
6

Many self-supervised learning (SSL) methods have been successful in learning semantically meaningful visual representations by solving pretext tasks. However, state-of-the-art SSL methods focus on object recognition or detection tasks, which aim to learn object shapes, but ignore visual attributes such as color and texture via color distortion augmentation. However, learning these visual attributes could be more important than learning object shapes for other vision tasks, such as fashion compatibility. To address this deficiency, we propose Self-supervised Tasks for Outfit Compatibility (STOC) without any supervision. Specifically, STOC aims to learn colors and textures of fashion items and embed similar items nearby. STOC outperforms state-of-the-art SSL by 9.5 completion task on our unsupervised benchmark.

READ FULL TEXT

page 12

page 13

page 17

page 18

research
06/13/2022

Learning Fashion Compatibility from In-the-wild Images

Complementary fashion recommendation aims at identifying items from diff...
research
12/27/2022

Semi-supervised Fashion Compatibility Prediction by Color Distortion Prediction

Supervised learning methods have been suffering from the fact that a lar...
research
12/06/2021

A Tale of Color Variants: Representation and Self-Supervised Learning in Fashion E-Commerce

In this paper, we address a crucial problem in fashion e-commerce (with ...
research
06/25/2022

SAT: Self-adaptive training for fashion compatibility prediction

This paper presents a self-adaptive training (SAT) model for fashion com...
research
08/17/2023

ICAR: Image-based Complementary Auto Reasoning

Scene-aware Complementary Item Retrieval (CIR) is a challenging task whi...
research
03/16/2019

Domain Generalization by Solving Jigsaw Puzzles

Human adaptability relies crucially on the ability to learn and merge kn...
research
03/31/2016

Modeling Visual Compatibility through Hierarchical Mid-level Elements

In this paper we present a hierarchical method to discover mid-level ele...

Please sign up or login with your details

Forgot password? Click here to reset