Constructing Complexity-efficient Features in XCS with Tree-based Rule Conditions

04/23/2020
by   Trung B. Nguyen, et al.
0

A major goal of machine learning is to create techniques that abstract away irrelevant information. The generalisation property of standard Learning Classifier System (LCS) removes such information at the feature level but not at the feature interaction level. Code Fragments (CFs), a form of tree-based programs, introduced feature manipulation to discover important interactions, but they often contain irrelevant information, which causes structural inefficiency. XOF is a recently introduced LCS that uses CFs to encode building blocks of knowledge about feature interaction. This paper aims to optimise the structural efficiency of CFs in XOF. We propose two measures to improve constructing CFs to achieve this goal. Firstly, a new CF-fitness update estimates the applicability of CFs that also considers the structural complexity. The second measure we can use is a niche-based method of generating CFs. These approaches were tested on Even-parity and Hierarchical problems, which require highly complex combinations of input features to capture the data patterns. The results show that the proposed methods significantly increase the structural efficiency of CFs, which is estimated by the rule "generality rate". This results in faster learning performance in the Hierarchical Majority-on problem. Furthermore, a user-set depth limit for CF generation is not needed as the learning agent will not adopt higher-level CFs once optimal CFs are constructed.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/02/2020

A Layered Learning Approach to Scaling in Learning Classifier Systems for Boolean Problems

Learning classifier systems (LCSs) originated from cognitive-science res...
research
05/08/2020

Relatedness Measures to Aid the Transfer of Building Blocks among Multiple Tasks

Multitask Learning is a learning paradigm that deals with multiple diffe...
research
08/12/2023

How complex is the microarray dataset? A novel data complexity metric for biological high-dimensional microarray data

Data complexity analysis quantifies the hardness of constructing a predi...
research
05/11/2021

Hierarchical RNNs-Based Transformers MADDPG for Mixed Cooperative-Competitive Environments

At present, attention mechanism has been widely applied to the fields of...
research
04/24/2023

Hierarchical State Abstraction Based on Structural Information Principles

State abstraction optimizes decision-making by ignoring irrelevant envir...
research
12/10/2021

Interaction-Aware Sensitivity Analysis for Aerodynamic Optimization Results using Information Theory

An important issue during an engineering design process is to develop an...
research
03/21/2019

Subgraph Networks with Application to Structural Feature Space Expansion

In this paper, the concept of subgraph network (SGN) is introduced and t...

Please sign up or login with your details

Forgot password? Click here to reset