ALADIN: All Layer Adaptive Instance Normalization for Fine-grained Style Similarity

03/17/2021
by   Dan Ruta, et al.
0

We present ALADIN (All Layer AdaIN); a novel architecture for searching images based on the similarity of their artistic style. Representation learning is critical to visual search, where distance in the learned search embedding reflects image similarity. Learning an embedding that discriminates fine-grained variations in style is hard, due to the difficulty of defining and labelling style. ALADIN takes a weakly supervised approach to learning a representation for fine-grained style similarity of digital artworks, leveraging BAM-FG, a novel large-scale dataset of user generated content groupings gathered from the web. ALADIN sets a new state of the art accuracy for style-based visual search over both coarse labelled style data (BAM) and BAM-FG; a new 2.62 million image dataset of 310,000 fine-grained style groupings also contributed by this work.

READ FULL TEXT

page 1

page 4

page 6

page 8

research
03/10/2022

StyleBabel: Artistic Style Tagging and Captioning

We present StyleBabel, a unique open access dataset of natural language ...
research
09/10/2021

Does It Capture STEL? A Modular, Similarity-based Linguistic Style Evaluation Framework

Style is an integral part of natural language. However, evaluation metho...
research
08/31/2023

Learning to Taste: A Multimodal Wine Dataset

We present WineSensed, a large multimodal wine dataset for studying the ...
research
09/26/2017

Image similarity using Deep CNN and Curriculum Learning

Image similarity involves fetching similar looking images given a refere...
research
12/30/2015

Improving Style Similarity Metrics of 3D Shapes

The idea of style similarity metrics has been recently developed for var...
research
08/01/2022

Large-Scale Product Retrieval with Weakly Supervised Representation Learning

Large-scale weakly supervised product retrieval is a practically useful ...
research
08/24/2021

ProtoMIL: Multiple Instance Learning with Prototypical Parts for Fine-Grained Interpretability

Multiple Instance Learning (MIL) gains popularity in many real-life mach...

Please sign up or login with your details

Forgot password? Click here to reset