Mimicking the Behaviour of Idiotypic AIS Robot Controllers Using Probabilistic Systems

03/22/2010
by   Amanda Whitbrook, et al.
0

Previous work has shown that robot navigation systems that employ an architecture based upon the idiotypic network theory of the immune system have an advantage over control techniques that rely on reinforcement learning only. This is thought to be a result of intelligent behaviour selection on the part of the idiotypic robot. In this paper an attempt is made to imitate idiotypic dynamics by creating controllers that use reinforcement with a number of different probabilistic schemes to select robot behaviour. The aims are to show that the idiotypic system is not merely performing some kind of periodic random behaviour selection, and to try to gain further insight into the processes that govern the idiotypic mechanism. Trials are carried out using simulated Pioneer robots that undertake navigation exercises. Results show that a scheme that boosts the probability of selecting highly-ranked alternative behaviours to 50 during stall conditions comes closest to achieving the properties of the idiotypic system, but remains unable to match it in terms of all round performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/18/2010

The Use of Probabilistic Systems to Mimic the Behaviour of Idiotypic AIS Robot Controllers

Previous work has shown that robot navigation systems that employ an arc...
research
06/02/2021

Robot in a China Shop: Using Reinforcement Learning for Location-Specific Navigation Behaviour

Robots need to be able to work in multiple different environments. Even ...
research
03/06/2021

Passing Through Narrow Gaps with Deep Reinforcement Learning

The DARPA subterranean challenge requires teams of robots to traverse di...
research
05/20/2020

Learning and Reasoning for Robot Dialog and Navigation Tasks

Reinforcement learning and probabilistic reasoning algorithms aim at lea...
research
02/21/2015

Reinforcement Learning in a Neurally Controlled Robot Using Dopamine Modulated STDP

Recent work has shown that dopamine-modulated STDP can solve many of the...
research
12/16/2020

A comparative evaluation of machine learning methods for robot navigation through human crowds

Robot navigation through crowds poses a difficult challenge to AI system...
research
05/29/2020

Environmental regulation using Plasticoding for the evolution of robots

Evolutionary robot systems are usually affected by the properties of the...

Please sign up or login with your details

Forgot password? Click here to reset