Intrinsically Motivated Multimodal Structure Learning

07/15/2016
by   Jay Ming Wong, et al.
0

We present a long-term intrinsically motivated structure learning method for modeling transition dynamics during controlled interactions between a robot and semi-permanent structures in the world. In particular, we discuss how partially-observable state is represented using distributions over a Markovian state and build models of objects that predict how state distributions change in response to interactions with such objects. These structures serve as the basis for a number of possible future tasks defined as Markov Decision Processes (MDPs). The approach is an example of a structure learning technique applied to a multimodal affordance representation that yields a population of forward models for use in planning. We evaluate the approach using experiments on a bimanual mobile manipulator (uBot-6) that show the performance of model acquisition as the number of transition actions increases.

READ FULL TEXT
research
02/20/2015

Decentralized Control of Partially Observable Markov Decision Processes using Belief Space Macro-actions

The focus of this paper is on solving multi-robot planning problems in c...
research
10/31/2011

First Order Decision Diagrams for Relational MDPs

Markov decision processes capture sequential decision making under uncer...
research
04/18/2020

iCORPP: Interleaved Commonsense Reasoning and Probabilistic Planning on Robots

Robot sequential decision-making in the real world is a challenge becaus...
research
01/12/2022

Planning in Observable POMDPs in Quasipolynomial Time

Partially Observable Markov Decision Processes (POMDPs) are a natural an...
research
11/29/2019

Learning and Planning for Time-Varying MDPs Using Maximum Likelihood Estimation

This paper proposes a formal approach to learning and planning for agent...
research
10/25/2017

Multimodal Probabilistic Model-Based Planning for Human-Robot Interaction

This paper presents a method for constructing human-robot interaction po...
research
01/28/2018

Multiple Object Detection, Tracking and Long-Term Dynamics Learning in Large 3D Maps

In this work, we present a method for tracking and learning the dynamics...

Please sign up or login with your details

Forgot password? Click here to reset