DeepAI AI Chat
Log In Sign Up

Classifying concepts via visual properties

by   Fausto Giunchiglia, et al.

We assume that substances in the world are represented by two types of concepts, namely substance concepts and classification concepts, the former instrumental to (visual) perception, the latter to (language based) classification. Based on this distinction, we introduce a general methodology for building lexico-semantic hierarchies of substance concepts, where nodes are annotated with the media, e.g.,videos or photos, from which substance concepts are extracted, and are associated with the corresponding classification concepts. The methodology is based on Ranganathan's original faceted approach, contextualized to the problem of classifying substance concepts. The key novelty is that the hierarchy is built exploiting the visual properties of substance concepts, while the linguistically defined properties of classification concepts are only used to describe substance concepts. The validity of the approach is exemplified by providing some highlights of an ongoing project whose goal is to build a large scale multimedia multilingual concept hierarchy.


page 1

page 2

page 3

page 4


Object Recognition as Classification via Visual Properties

We base our work on the teleosemantic modelling of concepts as abilities...

Multilingual Visual Sentiment Concept Matching

The impact of culture in visual emotion perception has recently captured...

Towards Visual Semantics

In Visual Semantics we study how humans build mental representations, i....

Towards ontology driven learning of visual concept detectors

The maturity of deep learning techniques has led in recent years to a br...

Building Hierarchies of Concepts via Crowdsourcing

Hierarchies of concepts are useful in many applications from navigation ...

Is it a Fruit, an Apple or a Granny Smith? Predicting the Basic Level in a Concept Hierarchy

The "basic level", according to experiments in cognitive psychology, is ...