An information-theoretic on-line update principle for perception-action coupling

04/16/2018
by   Zhen Peng, et al.
0

Inspired by findings of sensorimotor coupling in humans and animals, there has recently been a growing interest in the interaction between action and perception in robotic systems [Bogh et al., 2016]. Here we consider perception and action as two serial information channels with limited information-processing capacity. We follow [Genewein et al., 2015] and formulate a constrained optimization problem that maximizes utility under limited information-processing capacity in the two channels. As a solution we obtain an optimal perceptual channel and an optimal action channel that are coupled such that perceptual information is optimized with respect to downstream processing in the action module. The main novelty of this study is that we propose an online optimization procedure to find bounded-optimal perception and action channels in parameterized serial perception-action systems. In particular, we implement the perceptual channel as a multi-layer neural network and the action channel as a multinomial distribution. We illustrate our method in a NAO robot simulator with a simplified cup lifting task.

READ FULL TEXT
research
03/05/2019

Deep Active Localization

Active localization is the problem of generating robot actions that allo...
research
03/25/2010

Perceptual analyses of action-related impact sounds

Among environmental sounds, we have chosen to study a class of action-re...
research
05/19/2020

Perceptual similarity between piano notes: Simulations with a template-based perception model

In this paper the auditory model developed by Dau et al. [J. Acoust. Soc...
research
10/23/2018

A predictive processing model of perception and action for self-other distinction

During interaction with others, we perceive and produce social actions i...
research
01/23/2020

Action Recognition and State Change Prediction in a Recipe Understanding Task Using a Lightweight Neural Network Model

Consider a natural language sentence describing a specific step in a foo...
research
01/02/2023

Data-Driven Optimization of Directed Information over Discrete Alphabets

Directed information (DI) is a fundamental measure for the study and ana...
research
09/17/2020

Attracting Sets in Perceptual Networks

This document gives a specification for the model used in [1]. It presen...

Please sign up or login with your details

Forgot password? Click here to reset