Deep Symbolic Learning: Discovering Symbols and Rules from Perceptions

08/24/2022
by   Alessandro Daniele, et al.
0

Neuro-Symbolic (NeSy) integration combines symbolic reasoning with Neural Networks (NNs) for tasks requiring perception and reasoning. Most NeSy systems rely on continuous relaxation of logical knowledge and no discrete decisions are made within the model pipeline. Furthermore, these methods assume that the symbolic rules are given. In this paper, we propose Deep Symbolic Learning (DSL), a NeSy system that learns NeSy-functions, i.e., the composition of a (set of) perception functions which map continuous data to discrete symbols, and a symbolic function over the set of symbols. DSL learns simultaneously the perception and symbolic functions, while being trained only on their composition (NeSy-function). The key novelty of DSL is that it can create internal (interpretable) symbolic representations and map them to perception inputs within a differentiable NN learning pipeline. The created symbols are automatically selected to generate symbolic functions that best explain the data. We provide experimental analysis to substantiate the efficacy of DSL in simultaneously learning perception and symbolic functions.

READ FULL TEXT
research
05/05/2023

Improved Logical Reasoning of Language Models via Differentiable Symbolic Programming

Pre-trained large language models (LMs) struggle to perform logical reas...
research
07/11/2017

Learning like humans with Deep Symbolic Networks

We introduce the Deep Symbolic Network (DSN) model, which aims at becomi...
research
05/02/2019

Learning Programmatically Structured Representations with Perceptor Gradients

We present the perceptor gradients algorithm -- a novel approach to lear...
research
01/04/2022

Discrete and continuous representations and processing in deep learning: Looking forward

Discrete and continuous representations of content (e.g., of language or...
research
05/31/2017

End-to-End Differentiable Proving

We introduce neural networks for end-to-end differentiable proving of qu...
research
11/03/2017

SPARK: Static Program Analysis Reasoning and Retrieving Knowledge

Program analysis is a technique to reason about programs without executi...
research
09/13/2018

Sequential Coordination of Deep Models for Learning Visual Arithmetic

Achieving machine intelligence requires a smooth integration of percepti...

Please sign up or login with your details

Forgot password? Click here to reset