Learning Opposites Using Neural Networks

09/16/2016
by   Shivam Kalra, et al.
0

Many research works have successfully extended algorithms such as evolutionary algorithms, reinforcement agents and neural networks using "opposition-based learning" (OBL). Two types of the "opposites" have been defined in the literature, namely type-I and type-II. The former are linear in nature and applicable to the variable space, hence easy to calculate. On the other hand, type-II opposites capture the "oppositeness" in the output space. In fact, type-I opposites are considered a special case of type-II opposites where inputs and outputs have a linear relationship. However, in many real-world problems, inputs and outputs do in fact exhibit a nonlinear relationship. Therefore, type-II opposites are expected to be better in capturing the sense of "opposition" in terms of the input-output relation. In the absence of any knowledge about the problem at hand, there seems to be no intuitive way to calculate the type-II opposites. In this paper, we introduce an approach to learn type-II opposites from the given inputs and their outputs using the artificial neural networks (ANNs). We first perform opposition mining on the sample data, and then use the mined data to learn the relationship between input x and its opposite x̆. We have validated our algorithm using various benchmark functions to compare it against an evolving fuzzy inference approach that has been recently introduced. The results show the better performance of a neural approach to learn the opposites. This will create new possibilities for integrating oppositional schemes within existing algorithms promising a potential increase in convergence speed and/or accuracy.

READ FULL TEXT
research
04/21/2015

Learning Opposites with Evolving Rules

The idea of opposition-based learning was introduced 10 years ago. Since...
research
10/20/2016

Using Fast Weights to Attend to the Recent Past

Until recently, research on artificial neural networks was largely restr...
research
08/01/2022

What Can Transformers Learn In-Context? A Case Study of Simple Function Classes

In-context learning refers to the ability of a model to condition on a p...
research
11/18/2019

Accurate Trajectory Prediction for Autonomous Vehicles

Predicting vehicle trajectories, angle and speed is important for safe a...
research
08/07/2011

Evolving A-Type Artificial Neural Networks

We investigate Turing's notion of an A-type artificial neural network. W...
research
01/24/2019

Recovering Pairwise Interactions Using Neural Networks

Recovering pairwise interactions, i.e. pairs of input features whose joi...

Please sign up or login with your details

Forgot password? Click here to reset