RoboBrain: Large-Scale Knowledge Engine for Robots

12/01/2014
by   Ashutosh Saxena, et al.
0

In this paper we introduce a knowledge engine, which learns and shares knowledge representations, for robots to carry out a variety of tasks. Building such an engine brings with it the challenge of dealing with multiple data modalities including symbols, natural language, haptic senses, robot trajectories, visual features and many others. The knowledge stored in the engine comes from multiple sources including physical interactions that robots have while performing tasks (perception, planning and control), knowledge bases from the Internet and learned representations from several robotics research groups. We discuss various technical aspects and associated challenges such as modeling the correctness of knowledge, inferring latent information and formulating different robotic tasks as queries to the knowledge engine. We describe the system architecture and how it supports different mechanisms for users and robots to interact with the engine. Finally, we demonstrate its use in three important research areas: grounding natural language, perception, and planning, which are the key building blocks for many robotic tasks. This knowledge engine is a collaborative effort and we call it RoboBrain.

READ FULL TEXT

page 1

page 7

research
06/24/2018

The Perception of Humanoid Robots for Domestic Use in Saudi Arabia

We propose a research to investigate Saudi peoples' perception of humano...
research
09/08/2016

Learning Lexical Entries for Robotic Commands using Crowdsourcing

Robotic commands in natural language usually contain various spatial des...
research
05/25/2022

Understanding Natural Language in Context

Recent years have seen an increasing number of applications that have a ...
research
04/16/2017

FML-based Prediction Agent and Its Application to Game of Go

In this paper, we present a robotic prediction agent including a darkfor...
research
11/22/2019

RoboSherlock: Cognition-enabled Robot Perception for Everyday Manipulation Tasks

A pressing question when designing intelligent autonomous systems is how...
research
09/02/2019

qiBullet, a Bullet-based simulator for the Pepper and NAO robots

The Pepper and NAO robots are widely used for in-store advertizing and e...
research
01/02/2021

Semantics for Robotic Mapping, Perception and Interaction: A Survey

For robots to navigate and interact more richly with the world around th...

Please sign up or login with your details

Forgot password? Click here to reset