Visual Ground Truth Construction as Faceted Classification

02/17/2022
by   Fausto Giunchiglia, et al.
0

Recent work in Machine Learning and Computer Vision has provided evidence of systematic design flaws in the development of major object recognition benchmark datasets. One such example is ImageNet, wherein, for several categories of images, there are incongruences between the objects they represent and the labels used to annotate them. The consequences of this problem are major, in particular considering the large number of machine learning applications, not least those based on Deep Neural Networks, that have been trained on these datasets. In this paper we posit the problem to be the lack of a knowledge representation (KR) methodology providing the foundations for the construction of these ground truth benchmark datasets. Accordingly, we propose a solution articulated in three main steps: (i) deconstructing the object recognition process in four ordered stages grounded in the philosophical theory of teleosemantics; (ii) based on such stratification, proposing a novel four-phased methodology for organizing objects in classification hierarchies according to their visual properties; and (iii) performing such classification according to the faceted classification paradigm. The key novelty of our approach lies in the fact that we construct the classification hierarchies from visual properties exploiting visual genus-differentiae, and not from linguistically grounded properties. The proposed approach is validated by a set of experiments on the ImageNet hierarchy of musical experiments.

READ FULL TEXT
research
07/26/2023

A semantics-driven methodology for high-quality image annotation

Recent work in Machine Learning and Computer Vision has highlighted the ...
research
12/20/2021

Object Recognition as Classification via Visual Properties

We base our work on the teleosemantic modelling of concepts as abilities...
research
03/27/2018

DeepScores -- A Dataset for Segmentation, Detection and Classification of Tiny Objects

We present the DeepScores dataset with the goal of advancing the state-o...
research
04/18/2023

Incremental Image Labeling via Iterative Refinement

Data quality is critical for multimedia tasks, while various types of sy...
research
03/22/2015

Lifting Object Detection Datasets into 3D

While data has certainly taken the center stage in computer vision in re...
research
10/28/2014

A hierarchical framework for object recognition

Object recognition in the presence of background clutter and distractors...
research
01/29/2019

Semantic Redundancies in Image-Classification Datasets: The 10 Don't Need

Large datasets have been crucial to the success of deep learning models ...

Please sign up or login with your details

Forgot password? Click here to reset