Self-organized adaptation of a simple neural circuit enables complex robot behaviour

05/06/2011

∙

by Silke Steingrube, et al.

∙

GWDG

∙

Controlling sensori-motor systems in higher animals or complex robots is a challenging combinatorial problem, because many sensory signals need to be simultaneously coordinated into a broad behavioural spectrum. To rapidly interact with the environment, this control needs to be fast and adaptive. Current robotic solutions operate with limited autonomy and are mostly restricted to few behavioural patterns. Here we introduce chaos control as a new strategy to generate complex behaviour of an autonomous robot. In the presented system, 18 sensors drive 18 motors via a simple neural control circuit, thereby generating 11 basic behavioural patterns (e.g., orienting, taxis, self-protection, various gaits) and their combinations. The control signal quickly and reversibly adapts to new situations and additionally enables learning and synaptic long-term storage of behaviourally useful motor responses. Thus, such neural control provides a powerful yet simple way to self-organize versatile behaviours in autonomous agents with many degrees of freedom.

READ FULL TEXT VIEW PDF

References

(1) Bernstein, N. A. The coordination and regulation of movements. Oxford, New York: Pergamon Press (1967).
(2) Grillner, S. Biological pattern generation: The cellular and computational logic of networks in motion. $N e u r o n$ 52, 751–766 (2006).
(3)
Büschges, A. Sensory control and organization of neural networks mediating coordination of multisegmental organs for locomotion.
$J .$ $N e u r o p h y s i o l .$ 93, 1127–1135 (2005).
(4) Pearson, K. G. & Franklin, R. Characteristics of leg movements and patterns of coordination in locusts walking on rough terrain. $I n t .$ $J .$ $R o b o t .$ $R e s .$ 3, 101–112 (1984).
(5) Ijspeert, A. J. Central pattern generators for locomotion control in animals and robots: A review. $N e u r a l$ $N e t w o r k s$ 21, 642–653 (2008).
(6) Brooks, R. A. A robust layered control systems for a mobile robot. $I E E E$ $T .$ $R o b o t i c$ $A u t o m .$ 2(1), 14–23 (1986).
(7) Kurazume, R., Yoneda, K. & Hirose, S. Feedforward and feedback dynamic trot gait control for quadruped walking vehicle, $A u t o n .$ $R o b o t$ 12(2), 157–172 (2002).
(8) Shkolnik, A. & Tedrake, R. Inverse kinematics for a point-foot quadruped robot with dynamic redundancy resolution. $P r o c .$ $I E E E$ $I n t .$ $C o n f .$ $o n$ $R o b o t i c s$ $a n d$ $A u t o m a t i o n$ , 4331–4336 (2007).
(9) Ijspeert, A. J., Crespi, A., Ryczko, D. & Cabelguen J.M. From swimming to walking with a salamander robot driven by a spinal cord model, $S c i e n c e$ 315(5817), 1416–1420 (2007).
(10) Kimura, H., Fukuoka, Y. & Cohen, A. H. Adaptive dynamic walking of a quadruped robot on natural ground based on biological concepts. $I n t .$ $J .$ $R o b o t .$ $R e s .$ 26(5), 475–490 (2007).
(11) Collins, J. J. & Richmond, S. A. Hard-wired central pattern generators for quadrupedal locomotion. $B i o l .$ $C y b e r n .$ 71(5), 375–385 (1994).
(12) Ayers, J. & Witting, J. Biomimetic approaches to the control of underwater walking machines. $P h i l o s .$ $T .$ $R o y .$ $S o c .$ $A$ 365, 273–295 (2007).
(13) Ishiguro, A., Fujii, A. & Eggenberger Hotz, P. Neuromodulated control of bipedal locomotion using a polymorphic CPG circuit. $A d a p t .$ $B e h a v .$ 11(1), 7–17 (2003).
(14) Kuniyoshi, Y. & Sangawa, S. Early motor development from partially ordered neural-body dynamics: experiments with a cortico-spinal-musculo-skeletal model. $B i o l .$ $C y b e r n .$ 95(6), 589–605 (2006).
(15) Buchli, J., Righetti, L. & Ijspeert, A. J. Engineering entrainment and adaptation in limit cycle systems - from biological inspiration to applications in robotics. $B i o l .$ $C y b e r n .$ 95(6), 645–664 (2006).
(16) Arena, P., Fortuna, L., Frasca, M. & Sicurella, G. An adaptive, self-organizing dynamical system for hierarchical control of bio-inspired locomotion. $I E E E$ $T r a n s .$ $S y s t .$ $M a n$ & $C y b e r n .$ $B$ $C y b e r n .$ 34(4), 1823–1837 (2004).
(17) Rabinovich, M. I. & Abarbanel, H. D. I. The role of chaos in neural systems. $N e u r o s c i e n c e$ 87(1), 5–14 (1998).
(18) Wilson, D. M. Insect walking. $A n n u .$ $R e v .$ $E n t o m o l .$ 11, 103–122 (1966).
(19) Manoonpong, P., Pasemann, F. & Wörgötter, F. Sensor-Driven neural control for omnidirectional locomotion and versatile reactive behaviours of walking machines. $R o b o t .$ $A u t o n .$ $S y s t .$ 56(3), 265–288 (2008).
(20) Orlovsky, G. N., Deliagina, T. G. & Grillner, S. Neuronal control of locomotion: From mollusk to man, Oxford University Press (1999).
(21) Ott, E., Grebogi, C. & Yorke, J. A. Controlling chaos. $P h y s .$ $R e v .$ $L e t t .$ 64(11), 1196–1199 (1990).
(22) Schmelcher, P. & Diakonos, F. K. General approach to the localization of unstable periodic orbits in chaotic systems. $P h y s .$ $R e v .$ $E$ 57(3), 2739–2746 (1998).
(23) Schöll, E. & Schuster, H.G. Handbook of Chaos Control, Wiley-VCH, Berlin (2007).
(24) Schuster, H. G. Deterministic Chaos. An Introduction, Wiley-VCH, Berlin (2005).
(25) Schimansky-Geier, L., Fiedler, B., Kurths, J. & Schöll, E. Analysis and control of complex nonlinear processes in physics, chemistry and biology, World Scientific, Singapore (2007).
(26) Pasemann, F. Complex dynamics and the structure of small neural networks. $N e t w o r k$ 13, 195–216 (2002).
(27) van Vreeswijk, C. & Sompolinsky, H. Chaos in neuronal networks with balanced excitatory and inhibitory activity. $S c i e n c e$ 274(5293), 1724–1726 (1996).
(28) Brunel, N. Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. $J .$ $C o m p u t .$ $N e u r o s c i .$ 8, 183–208 (2000).
(29) Zillmer, R., Brunel, N. & Hansel, D. Very long transients, irregular firing, and chaotic dynamics in networks of randomly connected inhibitory integrate-and-fire neurons. $P h y s .$ $R e v .$ $E$ 79, 031909 (2009).
(30) Jahnke, S., Memmesheimer, R-M & Timme, M. Stable irregular dynamics in complex neural networks. $P h y s .$ $R e v .$ $L e t t .$ 100, 048102 (2008).
(31) Jahnke, S., Memmesheimer, R-M & Timme, M. How chaotic is the balanced state? $F r o n t .$ $C o m p u t .$ $N e u r o s c i .$ 3, 13 (2009).
(32) Hoyt, D. F. & Taylor, C. R. Gaits and the energetics of locomotion in horses. $N a t u r e$ 292, 239–240 (1981).
(33) Srinivasan, M. & Ruina, A. Computer Optimization of a minimal biped model discovers walking and running. $N a t u r e$ 439, 72–75 (2006).
(34) Delcomyn, F. Walking robots and the central and peripheral control of locomotion in insects. $A u t o n .$ $R o b o t$ 7, 259–270 (1999).
(35) Klaassen, B., Linnemann, R., Spenneberg, D. & Kirchner, F. Biomimetic walking robot SCORPION: Control and modeling. $R o b o t .$ $A u t o n .$ $S y s t .$ 41, 69–76 (2002).
(36) Asa, K., Ishimura, K. & Wada, M. Behaviour transition between biped and quadruped walking by using bifurcation. $R o b o t .$ $A u t o n .$ $S y s t .$ 57, 155-160 (2009).
(37) Pearson, K. G. & Iles, J. F. Nervous mechanisms underlying intersegmental coordination of leg movements during walking in the cockroach. $J .$ $E x p .$ $B i o l .$ 58, 725–744 (1973).
(38) Gabriel, J. P. & Büschges, A. Control of stepping velocity in a single insect leg during walking. $P h i l o s .$ $T .$ $R o y .$ $S o c .$ $A$ 365, 251–271 (2007).
(39) Pfeifer, R., Lungarella, M. & Iida, F. Self-organization, embodiment, and biologically inspired robotics. $S c i e n c e$ 318(5853), 1088–1093 (2007).
(40) Beer, R. D., Quinn, R. D., Chiel, H. J. & Ritzmann, R. E. Biologically inspired approaches to robotics. $C o m m u n .$ $A C M$ , 30–38 (1997).
(41) Korn, H. & Faure, P. Is there chaos in the brain? II. Experimental evidence and related models. $C . R .$ $B i o l .$ 326(9), 787–840 (2003).
(42) Iida, F. & Pfeifer, R. Sensing through body dynamics. $R o b o t .$ $A u t o n .$ $S y s t .$ 54, 631–640 (2006).
(43) Pitti, A., Lungarella, M. & Kuniyoshi, Y. Exploration of natural dynamics through resonance and chaos. $P r o c .$ $o f$ $9 t h$ $C o n f .$ $o n$ $I n t e l l i g e n t$ $A u t o n o m o u s$ $S y s t e m s$ , 558–565 (2006).
(44) Wehner, R. Desert ant navigation: How miniature brains solve complex tasks. $J .$ $C o m p .$ $P h y s i o l .$ $A$ 189(8): 579–588, 2003.
(45) McVea, D. A. & Pearson, K. G. Long-lasting memories of obstacles guide leg movements in the walking cat. $J .$ $N e u r o s c i .$ 26, 1175–1178 (2007).
(46) Manoonpong, P., Pasemann, F. & Roth, H. Modular reactive neurocontrol for biologically-inspired walking machines. $I n t .$ $J .$ $R o b o t$ $R e s .$ 26(3), 301–331 (2007).
(47) Widrow, B. & Hoff, M. E. Adaptive switching circuit. $I R E$ $W E S C O N$ $C o n v .$ $R e c .$ , 96–104 (1960).

Self-organized adaptation of a simple neural circuit enables complex robot behaviour

Authors

Learning Representations of Spatial Displacement through Sensorimotor Prediction

On robot compliance. A cerebellar control approach

Embodiment Enables Non-Predictive Ways of Coping with Self-Caused Sensory Stimuli

Many-Joint Robot Arm Control with Recurrent Spiking Neural Networks

Versatile modular neural locomotion control with fast learning

Autonomous Functional Locomotion in a Tendon-Driven Limb via Limited Experience

Behavior coordination for self-adaptive robots using constraint-based configuration

References

Self-organized adaptation of a simple neural circuit enables complex robot behaviour

Authors

Related Research

Learning Representations of Spatial Displacement through Sensorimotor Prediction

On robot compliance. A cerebellar control approach

Embodiment Enables Non-Predictive Ways of Coping with Self-Caused Sensory Stimuli

Many-Joint Robot Arm Control with Recurrent Spiking Neural Networks

Versatile modular neural locomotion control with fast learning

Autonomous Functional Locomotion in a Tendon-Driven Limb via Limited Experience

Behavior coordination for self-adaptive robots using constraint-based configuration

This week in AI

References