An Algorithm to Extract Rules from Artificial Neural Networks for Medical Diagnosis Problems

09/23/2010
by   S. M. Kamruzzaman, et al.
0

Artificial neural networks (ANNs) have been successfully applied to solve a variety of classification and function approximation problems. Although ANNs can generally predict better than decision trees for pattern classification problems, ANNs are often regarded as black boxes since their predictions cannot be explained clearly like those of decision trees. This paper presents a new algorithm, called rule extraction from ANNs (REANN), to extract rules from trained ANNs for medical diagnosis problems. A standard three-layer feedforward ANN with four-phase training is the basis of the proposed algorithm. In the first phase, the number of hidden nodes in ANNs is determined automatically by a constructive algorithm. In the second phase, irrelevant connections and input nodes are removed from trained ANNs without sacrificing the predictive accuracy of ANNs. The continuous activation values of the hidden nodes are discretized by using an efficient heuristic clustering algorithm in the third phase. Finally, rules are extracted from compact ANNs by examining the discretized activation values of the hidden nodes. Extensive experimental studies on three benchmark classification problems, i.e. breast cancer, diabetes and lenses, demonstrate that REANN can generate high quality rules from ANNs, which are comparable with other methods in terms of number of rules, average number of conditions for a rule, and predictive accuracy.

READ FULL TEXT
research
09/23/2010

Extraction of Symbolic Rules from Artificial Neural Networks

Although backpropagation ANNs generally predict better than decision tre...
research
09/25/2010

Extracting Symbolic Rules for Medical Diagnosis Problem

Neural networks (NNs) have been successfully applied to solve a variety ...
research
09/25/2010

Rule Extraction using Artificial Neural Networks

Artificial neural networks have been successfully applied to a variety o...
research
09/25/2010

RGANN: An Efficient Algorithm to Extract Rules from ANNs

This paper describes an efficient rule generation algorithm, called rule...
research
09/25/2010

REx: An Efficient Rule Generator

This paper describes an efficient algorithm REx for generating symbolic ...
research
09/23/2010

Medical diagnosis using neural network

This research is to search for alternatives to the resolution of complex...
research
09/25/2010

Pattern Classification using Simplified Neural Networks

In recent years, many neural network models have been proposed for patte...

Please sign up or login with your details

Forgot password? Click here to reset