Texel-Att: Representing and Classifying Element-based Textures by Attributes

08/29/2019
by   Marco Godi, et al.
11

Element-based textures are a kind of texture formed by nameable elements, the texels [1], distributed according to specific statistical distributions; it is of primary importance in many sectors, namely textile, fashion and interior design industry. State-of-theart texture descriptors fail to properly characterize element-based texture, so we present Texel-Att to fill this gap. Texel-Att is the first fine-grained, attribute-based representation and classification framework for element-based textures. It first individuates texels, characterizing them with individual attributes; subsequently, texels are grouped and characterized through layout attributes, which give the Texel-Att representation. Texels are detected by a Mask-RCNN, trained on a brand-new element-based texture dataset, ElBa, containing 30K texture images with 3M fully-annotated texels. Examples of individual and layout attributes are exhibited to give a glimpse on the level of achievable graininess. In the experiments, we present detection results to show that texels can be precisely individuated, even on textures "in the wild"; to this sake, we individuate the element-based classes of the Describable Texture Dataset (DTD), where almost 900K texels have been manually annotated, leading to the Element-based DTD (E-DTD). Subsequently, classification and ranking results demonstrate the expressivity of Texel-Att on ElBa and E-DTD, overcoming the alternative features and relative attributes, doubling the best performance in some cases; finally, we report interactive search results on ElBa and E-DTD: with Texel-Att on the E-DTD dataset we are able to individuate within 10 iterations the desired texture in the 90 combination of the finest existing attributes so far. Dataset and code is available at https://github.com/godimarcovr/Texel-Att

READ FULL TEXT

page 1

page 2

page 3

page 5

page 6

page 7

research
08/03/2020

Describing Textures using Natural Language

Textures in natural images can be characterized by color, shape, periodi...
research
08/29/2019

Texture Retrieval in the Wild through detection-based attributes

Capturing the essence of a textile image in a robust way is important to...
research
11/14/2013

Describing Textures in the Wild

Patterns and textures are defining characteristics of many natural objec...
research
07/02/2019

Visualizing and Describing Fine-grained Categories as Textures

We analyze how categories from recent FGVC challenges can be described b...
research
12/19/2018

A comparative study of texture attributes for characterizing subsurface structures in seismic volumes

In this paper, we explore how to computationally characterize subsurface...
research
03/28/2018

Investigating the hybrid textures of neutrino mass matrix for near maximal atmospheric neutrino mixing

In the present paper, we have studied that the implication of a large va...
research
03/22/2022

Leveraging Textures in Zero-shot Understanding of Fine-Grained Domains

Textures can be used to describe the appearance of objects in a wide ran...

Please sign up or login with your details

Forgot password? Click here to reset