Deep Active Visual Attention for Real-time Robot Motion Generation: Emergence of Tool-body Assimilation and Adaptive Tool-use

06/29/2022
by   Hyogo Hiruma, et al.
0

Sufficiently perceiving the environment is a critical factor in robot motion generation. Although the introduction of deep visual processing models have contributed in extending this ability, existing methods lack in the ability to actively modify what to perceive; humans perform internally during visual cognitive processes. This paper addresses the issue by proposing a novel robot motion generation model, inspired by a human cognitive structure. The model incorporates a state-driven active top-down visual attention module, which acquires attentions that can actively change targets based on task states. We term such attentions as role-based attentions, since the acquired attention directed to targets that shared a coherent role throughout the motion. The model was trained on a robot tool-use task, in which the role-based attentions perceived the robot grippers and tool as identical end-effectors, during object picking and object dragging motions respectively. This is analogous to a biological phenomenon called tool-body assimilation, in which one regards a handled tool as an extension of one's body. The results suggested an improvement of flexibility in model's visual perception, which sustained stable attention and motion even if it was provided with untrained tools or exposed to experimenter's distractions.

READ FULL TEXT

page 1

page 5

page 6

page 7

research
07/27/2018

Attention-based Active Visual Search for Mobile Robots

We present an active visual search model for finding objects in unknown ...
research
06/04/2021

How to select and use tools? : Active Perception of Target Objects Using Multimodal Deep Learning

Selection of appropriate tools and use of them when performing daily tas...
research
02/21/2022

Guided Visual Attention Model Based on Interactions Between Top-down and Bottom-up Information for Robot Pose Prediction

Learning to control a robot commonly requires mapping between robot stat...
research
11/30/2020

Attention-Based Planning with Active Perception

Attention control is a key cognitive ability for humans to select inform...
research
09/24/2018

Online Tool and Task learning via Human Robot Interaction

This work describes the development of a robotic system that acquires kn...
research
07/29/2021

Using Visual Anomaly Detection for Task Execution Monitoring

Execution monitoring is essential for robots to detect and respond to fa...
research
01/16/2019

Timely Negotiation and Correction of Shared Intentions With Body Motion

Current robot architectures for modeling interaction behavior are not we...

Please sign up or login with your details

Forgot password? Click here to reset