Learning from Sparse Data by Exploiting Monotonicity Constraints

07/04/2012
by   Eric E. Altendorf, et al.
0

When training data is sparse, more domain knowledge must be incorporated into the learning algorithm in order to reduce the effective size of the hypothesis space. This paper builds on previous work in which knowledge about qualitative monotonicities was formally represented and incorporated into learning algorithms (e.g., Clark & Matwin's work with the CN2 rule learning algorithm). We show how to interpret knowledge of qualitative influences, and in particular of monotonicities, as constraints on probability distributions, and to incorporate this knowledge into Bayesian network learning algorithms. We show that this yields improved accuracy, particularly with very small training sets (e.g. less than 10 examples).

READ FULL TEXT
research
01/25/2011

A Generalized Method for Integrating Rule-based Knowledge into Inductive Methods Through Virtual Sample Creation

Hybrid learning methods use theoretical knowledge of a domain and a set ...
research
01/16/2013

Exploiting Qualitative Knowledge in the Learning of Conditional Probabilities of Bayesian Networks

Algorithms for learning the conditional probabilities of Bayesian networ...
research
07/04/2012

Learning Bayesian Network Parameters with Prior Knowledge about Context-Specific Qualitative Influences

We present a method for learning the parameters of a Bayesian network wi...
research
05/18/2018

Solving the Rubik's Cube Without Human Knowledge

A generally intelligent agent must be able to teach itself how to solve ...
research
12/10/2017

A General Memory-Bounded Learning Algorithm

In an era of big data there is a growing need for memory-bounded learnin...
research
10/29/2020

Compensating data shortages in manufacturing with monotonicity knowledge

We present a regression method for enhancing the predictive power of a m...
research
05/30/2014

Generalization Bounds for Learning with Linear, Polygonal, Quadratic and Conic Side Knowledge

In this paper, we consider a supervised learning setting where side know...

Please sign up or login with your details

Forgot password? Click here to reset