Training Recurrent Neural Networks as a Constraint Satisfaction Problem

03/20/2018
by   Hamid Khodabandehlou, et al.
0

This paper presents a new approach for training artificial neural networks using techniques for solving the constraint satisfaction problem (CSP). The quotient gradient system (QGS) is a trajectory based method for solving the CSP. This study converts the training set of a neural network into a CSP and uses the QGS to find its solutions. The QGS finds the global minimum of the optimization problem by tracking trajectories of a nonlinear dynamical system and does not stop at a local minimum of the optimization problem. Lyapunov theory is used to prove the asymptotic stability of the solutions with and without the presence of measurement errors. Numerical examples illustrate the effectiveness of the proposed methodology and compare it to a genetic algorithm and error backpropagation

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

05/10/2018

Training Recurrent Neural Networks via Dynamical Trajectory-Based Optimization

This paper introduces a new method to train recurrent neural networks us...
01/15/2014

Solving Weighted Constraint Satisfaction Problems with Memetic/Exact Hybrid Algorithms

A weighted constraint satisfaction problem (WCSP) is a constraint satisf...
07/19/2020

Solving the Global Optimum of a Class of Minimization Problem

We study a special nonconvex optimization problem with a single spherica...
03/26/2021

Improved Initialization of State-Space Artificial Neural Networks

The identification of black-box nonlinear state-space models requires a ...
05/09/2011

On the Preliminary Design of Multiple Gravity-Assist Trajectories

In this paper the preliminary design of multiple gravity-assist trajecto...
04/13/2013

An Improved ACS Algorithm for the Solutions of Larger TSP Problems

Solving large traveling salesman problem (TSP) in an efficient way is a ...
10/18/2018

Nonlinear Mapping and Distance Geometry

Distance Geometry Problem (DGP) and Nonlinear Mapping (NLM) are two well...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.