Symbolic Learning and Reasoning with Noisy Data for Probabilistic Anchoring

Robotic agents should be able to learn from sub-symbolic sensor data, and at the same time, be able to reason about objects and communicate with humans on a symbolic level. This raises the question of how to overcome the gap between symbolic and sub-symbolic artificial intelligence. We propose a semantic world modeling approach based on bottom-up object anchoring using an object-centered representation of the world. Perceptual anchoring processes continuous perceptual sensor data and maintains a correspondence to a symbolic representation. We extend the definitions of anchoring to handle multi-modal probability distributions and we couple the resulting symbol anchoring system to a probabilistic logic reasoner for performing inference. Furthermore, we use statistical relational learning to enable the anchoring framework to learn symbolic knowledge in the form of a set of probabilistic logic rules of the world from noisy and sub-symbolic sensor input. The resulting framework, which combines perceptual anchoring and statistical relational learning, is able to maintain a semantic world model of all the objects that have been perceived over time, while still exploiting the expressiveness of logical rules to reason about the state of objects which are not directly observed through sensory input data. To validate our approach we demonstrate, on the one hand, the ability of our system to perform probabilistic reasoning over multi-modal probability distributions, and on the other hand, the learning of probabilistic logical rules from anchored objects produced by perceptual observations. The learned logical rules are, subsequently, used to assess our proposed probabilistic anchoring procedure. We demonstrate our system in a setting involving object interactions where object occlusions arise and where probabilistic inference is needed to correctly anchor objects.

READ FULL TEXT

page 1

page 8

page 9

page 15

page 16

page 17

page 18

research
02/26/2019

Semantic Relational Object Tracking

This paper addresses the topic of semantic world modeling by conjoining ...
research
03/18/2020

From Statistical Relational to Neuro-Symbolic Artificial Intelligence

Neuro-symbolic and statistical relational artificial intelligence both i...
research
06/14/2021

pix2rule: End-to-end Neuro-symbolic Rule Learning

Humans have the ability to seamlessly combine low-level visual input wit...
research
03/14/2023

SAILOR: Perceptual Anchoring For Robotic Cognitive Architectures

Symbolic anchoring is a crucial problem in the field of robotics, as it ...
research
01/15/2023

Planning for Learning Object Properties

Autonomous agents embedded in a physical environment need the ability to...
research
10/18/2021

Neuro-Symbolic Forward Reasoning

Reasoning is an essential part of human intelligence and thus has been a...
research
06/08/2023

Statistical relational learning and neuro-symbolic AI: what does first-order logic offer?

In this paper, our aim is to briefly survey and articulate the logical a...

Please sign up or login with your details

Forgot password? Click here to reset