Solving Bongard Problems with a Visual Language and Pragmatic Reasoning

04/12/2018
by   Stefan Depeweg, et al.
0

More than 50 years ago Bongard introduced 100 visual concept learning problems as a testbed for intelligent vision systems. These problems are now known as Bongard problems. Although they are well known in the cognitive science and AI communities only moderate progress has been made towards building systems that can solve a substantial subset of them. In the system presented here, visual features are extracted through image processing and then translated into a symbolic visual vocabulary. We introduce a formal language that allows representing complex visual concepts based on this vocabulary. Using this language and Bayesian inference, complex visual concepts can be induced from the examples that are provided in each Bongard problem. Contrary to other concept learning problems the examples from which concepts are induced are not random in Bongard problems, instead they are carefully chosen to communicate the concept, hence requiring pragmatic reasoning. Taking pragmatic reasoning into account we find good agreement between the concepts with high posterior probability and the solutions formulated by Bongard himself. While this approach is far from solving all Bongard problems, it solves the biggest fraction yet.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/23/2020

Interpretable Visual Reasoning via Induced Symbolic Space

We study the problem of concept induction in visual reasoning, i.e., ide...
research
09/23/2014

A Concept Learning Approach to Multisensory Object Perception

This paper presents a computational model of concept learning using Baye...
research
10/02/2020

Bongard-LOGO: A New Benchmark for Human-Level Concept Learning and Reasoning

Humans have an inherent ability to learn novel concepts from only a few ...
research
04/04/2022

"This is my unicorn, Fluffy": Personalizing frozen vision-language representations

Large Vision Language models pretrained on web-scale data provide re...
research
06/05/2023

Modeling Human-like Concept Learning with Bayesian Inference over Natural Language

We model learning of abstract symbolic concepts by performing Bayesian i...
research
11/06/2018

Concept Learning with Energy-Based Models

Many hallmarks of human intelligence, such as generalizing from limited ...
research
06/02/2020

Characterizing an Analogical Concept Memory for Architectures Implementing the Common Model of Cognition

Architectures that implement the Common Model of Cognition - Soar, ACT-R...

Please sign up or login with your details

Forgot password? Click here to reset