Empirical learning aided by weak domain knowledge in the form of feature importance

05/30/2010
by   Ridwan Al Iqbal, et al.
0

Standard hybrid learners that use domain knowledge require stronger knowledge that is hard and expensive to acquire. However, weaker domain knowledge can benefit from prior knowledge while being cost effective. Weak knowledge in the form of feature relative importance (FRI) is presented and explained. Feature relative importance is a real valued approximation of a feature's importance provided by experts. Advantage of using this knowledge is demonstrated by IANN, a modified multilayer neural network algorithm. IANN is a very simple modification of standard neural network algorithm but attains significant performance gains. Experimental results in the field of molecular biology show higher performance over other empirical learning algorithms including standard backpropagation and support vector machines. IANN performance is even comparable to a theory refinement system KBANN that uses stronger domain knowledge. This shows Feature relative importance can improve performance of existing empirical learning algorithms significantly with minimal effort.

READ FULL TEXT
research
01/25/2011

A Generalized Method for Integrating Rule-based Knowledge into Inductive Methods Through Virtual Sample Creation

Hybrid learning methods use theoretical knowledge of a domain and a set ...
research
09/05/2017

Learning the PE Header, Malware Detection with Minimal Domain Knowledge

Many efforts have been made to use various forms of domain knowledge in ...
research
01/25/2011

Using Feature Weights to Improve Performance of Neural Networks

Different features have different relevance to a particular learning pro...
research
01/05/2021

Learning Sign-Constrained Support Vector Machines

Domain knowledge is useful to improve the generalization performance of ...
research
11/04/2022

The Path to Autonomous Learners

In this paper, we present a new theoretical approach for enabling domain...
research
07/21/2021

How to Tell Deep Neural Networks What We Know

We present a short survey of ways in which existing scientific knowledge...
research
05/19/2019

Leveraging Semantic Embeddings for Safety-Critical Applications

Semantic Embeddings are a popular way to represent knowledge in the fiel...

Please sign up or login with your details

Forgot password? Click here to reset