Evaluating the Progress of Deep Learning for Visual Relational Concepts

01/29/2020
by   Sebastian Stabinger, et al.
12

Convolutional Neural Networks (CNNs) have become the state of the art method for image classification in the last 7 years, but despite the fact that they achieve super human performance on many classification datasets, there are lesser known datasets where they almost fail completely and perform much worse than humans. We will show that these problems correspond to relational concepts as defined by the field of concept learning. Therefore, we will present current deep learning research for visual relational concepts. Analyzing the current literature, we will hypothesise that iterative processing of the input, together with shifting attention between the iterations will be needed to efficiently and reliably solve real world relational concept learning. In addition, we will conclude that many current datasets overestimate the performance of tested systems by providing data in an already pre-attended form.

READ FULL TEXT

page 9

page 17

page 18

page 19

page 22

page 26

research
08/25/2017

Evaluation of Deep Learning on an Abstract Image Classification Dataset

Convolutional Neural Networks have become state of the art methods for i...
research
10/26/2021

Bootstrapping Concept Formation in Small Neural Networks

The question how neural systems (of humans) can perform reasoning is sti...
research
08/23/2023

Relational Concept Based Models

The design of interpretable deep learning models working in relational d...
research
11/08/2021

A Relational Model for One-Shot Classification

We show that a deep learning model with built-in relational inductive bi...
research
05/20/2022

Deep transfer learning for image classification: a survey

Deep neural networks such as convolutional neural networks (CNNs) and tr...
research
10/05/2017

Stacked Structure Learning for Lifted Relational Neural Networks

Lifted Relational Neural Networks (LRNNs) describe relational domains us...
research
09/18/2017

How intelligent are convolutional neural networks?

Motivated by the Gestalt pattern theory, and the Winograd Challenge for ...

Please sign up or login with your details

Forgot password? Click here to reset