MultiplexNet: Towards Fully Satisfied Logical Constraints in Neural Networks

11/02/2021
by   Nicholas Hoernle, et al.
0

We propose a novel way to incorporate expert knowledge into the training of deep neural networks. Many approaches encode domain constraints directly into the network architecture, requiring non-trivial or domain-specific engineering. In contrast, our approach, called MultiplexNet, represents domain knowledge as a logical formula in disjunctive normal form (DNF) which is easy to encode and to elicit from human experts. It introduces a Categorical latent variable that learns to choose which constraint term optimizes the error function of the network and it compiles the constraints directly into the output of existing learning algorithms. We demonstrate the efficacy of this approach empirically on several classical deep learning tasks, such as density estimation and classification in both supervised and unsupervised settings where prior knowledge about the domains was expressed as logical constraints. Our results show that the MultiplexNet approach learned to approximate unknown distributions well, often requiring fewer data samples than the alternative approaches. In some cases, MultiplexNet finds better solutions than the baselines; or solutions that could not be achieved with the alternative approaches. Our contribution is in encoding domain knowledge in a way that facilitates inference that is shown to be both efficient and general; and critically, our approach guarantees 100 output.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/27/2021

Incorporating Domain Knowledge into Deep Neural Networks

We present a survey of ways in which domain-knowledge has been included ...
research
05/19/2020

Improving Deep Learning Models via Constraint-Based Domain Knowledge: a Brief Survey

Deep Learning (DL) models proved themselves to perform extremely well on...
research
11/16/2022

Learning unfolded networks with a cyclic group structure

Deep neural networks lack straightforward ways to incorporate domain kno...
research
09/18/2016

Label-Free Supervision of Neural Networks with Physics and Domain Knowledge

In many machine learning applications, labeled data is scarce and obtain...
research
02/26/2019

Detecting Data Errors with Statistical Constraints

A powerful approach to detecting erroneous data is to check which potent...
research
08/27/2021

DomiKnowS: A Library for Integration of Symbolic Domain Knowledge in Deep Learning

We demonstrate a library for the integration of domain knowledge in deep...
research
07/19/2021

Incorporating domain knowledge into neural-guided search

Many AutoML problems involve optimizing discrete objects under a black-b...

Please sign up or login with your details

Forgot password? Click here to reset