Counterexample-Guided Learning of Monotonic Neural Networks

06/16/2020
by   Aishwarya Sivaraman, et al.
7

The widespread adoption of deep learning is often attributed to its automatic feature construction with minimal inductive bias. However, in many real-world tasks, the learned function is intended to satisfy domain-specific constraints. We focus on monotonicity constraints, which are common and require that the function's output increases with increasing values of specific input features. We develop a counterexample-guided technique to provably enforce monotonicity constraints at prediction time. Additionally, we propose a technique to use monotonicity as an inductive bias for deep learning. It works by iteratively incorporating monotonicity counterexamples in the learning process. Contrary to prior work in monotonic learning, we target general ReLU neural networks and do not further restrict the hypothesis space. We have implemented these techniques in a tool called COMET. Experiments on real-world datasets demonstrate that our approach achieves state-of-the-art results compared to existing monotonic learners, and can improve the model quality compared to those that were trained without taking monotonicity constraints into account.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 3

page 4

page 8

page 9

page 10

page 11

page 12

page 13

11/20/2020

Certified Monotonic Neural Networks

Learning monotonic models with respect to a subset of the inputs is a de...
09/24/2019

Monotonic Trends in Deep Neural Networks

The importance of domain knowledge in enhancing model performance and ma...
09/19/2017

Deep Lattice Networks and Partial Monotonic Functions

We propose learning deep models that are monotonic with respect to a use...
06/11/2021

Monotonic Neural Network: combining Deep Learning with Domain Knowledge for Chiller Plants Energy Optimization

In this paper, we are interested in building a domain knowledge based de...
01/23/2022

Deep Learning on Attributed Sequences

Recent research in feature learning has been extended to sequence data, ...
06/15/2020

Neural Networks Fail to Learn Periodic Functions and How to Fix It

Previous literature offers limited clues on how to learn a periodic func...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.