Regularizing Reasons for Outfit Evaluation with Gradient Penalty

02/02/2020
by   Xingxing Zou, et al.
0

In this paper, we build an outfit evaluation system which provides feedbacks consisting of a judgment with a convincing explanation. The system is trained in a supervised manner which faithfully follows the domain knowledge in fashion. We create the EVALUATION3 dataset which is annotated with judgment, the decisive reason for the judgment, and all corresponding attributes (e.g. print, silhouette, and material .). In the training process, features of all attributes in an outfit are first extracted and then concatenated as the input for the intra-factor compatibility net. Then, the inter-factor compatibility net is used to compute the loss for judgment. We penalize the gradient of judgment loss of so that our Grad-CAM-like reason is regularized to be consistent with the labeled reason. In inference, according to the obtained information of judgment, reason, and attributes, a user-friendly explanation sentence is generated by the pre-defined templates. The experimental results show that the obtained network combines the advantages of high precision and good interpretation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/03/2023

Fashionpedia-Taste: A Dataset towards Explaining Human Fashion Taste

Existing fashion datasets do not consider the multi-facts that cause a c...
research
04/28/2023

A New Class of Explanations for Classifiers with Non-Binary Features

Two types of explanations have received significant attention in the lit...
research
07/05/2020

Learning Color Compatibility in Fashion Outfits

Color compatibility is important for evaluating the compatibility of a f...
research
08/13/2020

Can We Trust Your Explanations? Sanity Checks for Interpreters in Android Malware Analysis

With the rapid growth of Android malware, many machine learning-based ma...
research
07/26/2019

Outfit Compatibility Prediction and Diagnosis with Multi-Layered Comparison Network

Existing works about fashion outfit compatibility focus on predicting th...
research
12/27/2022

Semi-supervised Fashion Compatibility Prediction by Color Distortion Prediction

Supervised learning methods have been suffering from the fact that a lar...

Please sign up or login with your details

Forgot password? Click here to reset