SaDe: Learning Models that Provably Satisfy Domain Constraints

12/01/2021
by   Kshitij Goyal, et al.
0

With increasing real world applications of machine learning, models are often required to comply with certain domain based requirements, e.g., safety guarantees in aircraft systems, legal constraints in a loan approval model. A natural way to represent these properties is in the form of constraints. Including such constraints in machine learning is typically done by the means of regularization, which does not guarantee satisfaction of the constraints. In this paper, we present a machine learning approach that can handle a wide variety of constraints, and guarantee that these constraints will be satisfied by the model even on unseen data. We cast machine learning as a maximum satisfiability problem, and solve it using a novel algorithm SaDe which combines constraint satisfaction with gradient descent. We demonstrate on three use cases that this approach learns models that provably satisfy the given constraints.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/02/2023

DeepSaDe: Learning Neural Networks that Guarantee Domain Constraint Satisfaction

As machine learning models, specifically neural networks, are becoming i...
research
03/13/2013

Possibilistic Constraint Satisfaction Problems or "How to handle soft constraints?"

Many AI synthesis problems such as planning or scheduling may be modeliz...
research
05/20/2020

An Analysis of Regularized Approaches for Constrained Machine Learning

Regularization-based approaches for injecting constraints in Machine Lea...
research
01/15/2023

Calibrated Data-Dependent Constraints with Exact Satisfaction Guarantees

We consider the task of training machine learning models with data-depen...
research
12/14/2018

Helix: Holistic Optimization for Accelerating Iterative Machine Learning

Machine learning workflow development is a process of trial-and-error: d...
research
04/07/2023

Machine Learning with Requirements: a Manifesto

In the recent years, machine learning has made great advancements that h...
research
07/10/2023

Learning to Solve Constraint Satisfaction Problems with Recurrent Transformer

Constraint satisfaction problems (CSPs) are about finding values of vari...

Please sign up or login with your details

Forgot password? Click here to reset