Closed loop interactions between spiking neural network and robotic simulators based on MUSIC and ROS

04/16/2016
by   Philipp Weidel, et al.
0

In order to properly assess the function and computational properties of simulated neural systems, it is necessary to account for the nature of the stimuli that drive the system. However, providing stimuli that are rich and yet both reproducible and amenable to experimental manipulations is technically challenging, and even more so if a closed-loop scenario is required. In this work, we present a novel approach to solve this problem, connecting robotics and neural network simulators. We implement a middleware solution that bridges the Robotic Operating System (ROS) to the Multi-Simulator Coordinator (MUSIC). This enables any robotic and neural simulators that implement the corresponding interfaces to be efficiently coupled, allowing real-time performance for a wide range of configurations. This work extends the toolset available for researchers in both neurorobotics and computational neuroscience, and creates the opportunity to perform closed-loop experiments of arbitrary complexity to address questions in multiple areas, including embodiment, agency, and reinforcement learning.

READ FULL TEXT

page 13

page 14

research
03/03/2020

Exploring vestibulo-ocular adaptation in a closed-loop neuro-robotic experiment using STDP. A simulation study

Studying and understanding the computational primitives of our neural sy...
research
05/07/2022

Factory: Fast Contact for Robotic Assembly

Robotic assembly is one of the oldest and most challenging applications ...
research
03/11/2019

A Spiking Network for Inference of Relations Trained with Neuromorphic Backpropagation

The increasing need for intelligent sensors in a wide range of everyday ...
research
01/16/2012

A Spiking Neural Learning Classifier System

Learning Classifier Systems (LCS) are population-based reinforcement lea...
research
03/05/2017

Reasoning About Liquids via Closed-Loop Simulation

Simulators are powerful tools for reasoning about a robot's interactions...
research
01/25/2021

ROS-NetSim: A Framework for the Integration of Robotic and Network Simulators

Multi-agent systems play an important role in modern robotics. Due to th...
research
03/22/2018

Robotic Sewing and Knot Tying for Personalized Stent Graft Manufacturing

This paper presents a versatile robotic system for sewing 3D structured ...

Please sign up or login with your details

Forgot password? Click here to reset