Enhancing a Neurocognitive Shared Visuomotor Model for Object Identification, Localization, and Grasping With Learning From Auxiliary Tasks

09/26/2020
by   Matthias Kerzel, et al.
3

We present a follow-up study on our unified visuomotor neural model for the robotic tasks of identifying, localizing, and grasping a target object in a scene with multiple objects. Our Retinanet-based model enables end-to-end training of visuomotor abilities in a biologically inspired developmental approach. In our initial implementation, a neural model was able to grasp selected objects from a planar surface. We embodied the model on the NICO humanoid robot. In this follow-up study, we expand the task and the model to reaching for objects in a three-dimensional space with a novel dataset based on augmented reality and a simulation environment. We evaluate the influence of training with auxiliary tasks, i.e., if learning of the primary visuomotor task is supported by learning to classify and locate different objects. We show that the proposed visuomotor model can learn to reach for objects in a three-dimensional space. We analyze the results for biologically-plausible biases based on object locations or properties. We show that the primary visuomotor task can be successfully trained simultaneously with one of the two auxiliary tasks. This is enabled by a complex neurocognitive model with shared and task-specific components, similar to models found in biological systems.

READ FULL TEXT

page 1

page 3

page 4

page 8

page 10

research
04/06/2021

Attribute-Based Robotic Grasping with One-Grasp Adaptation

Robotic grasping is one of the most fundamental robotic manipulation tas...
research
11/27/2021

GATER: Learning Grasp-Action-Target Embeddings and Relations for Task-Specific Grasping

Intelligent service robots require the ability to perform a variety of t...
research
07/06/2017

End-to-End Learning of Semantic Grasping

We consider the task of semantic robotic grasping, in which a robot pick...
research
04/03/2022

Learning High-DOF Reaching-and-Grasping via Dynamic Representation of Gripper-Object Interaction

We approach the problem of high-DOF reaching-and-grasping via learning j...
research
09/28/2016

Learning to Push by Grasping: Using multiple tasks for effective learning

Recently, end-to-end learning frameworks are gaining prevalence in the f...
research
08/10/2020

Grasping Field: Learning Implicit Representations for Human Grasps

In recent years, substantial progress has been made on robotic grasping ...
research
03/11/2022

Registering Articulated Objects With Human-in-the-loop Corrections

Remotely programming robots to execute tasks often relies on registering...

Please sign up or login with your details

Forgot password? Click here to reset