DeepAI AI Chat
Log In Sign Up

SA-Net: Deep Neural Network for Robot Trajectory Recognition from RGB-D Streams

by   Nihal Soans, et al.

Learning from demonstration (LfD) and imitation learning offer new paradigms for transferring task behavior to robots. A class of methods that enable such online learning require the robot to observe the task being performed and decompose the sensed streaming data into sequences of state-action pairs, which are then input to the methods. Thus, recognizing the state-action pairs correctly and quickly in sensed data is a crucial prerequisite for these methods. We present SA-Net a deep neural network architecture that recognizes state-action pairs from RGB-D data streams. SA-Net performed well in two diverse robotic applications of LfD -- one involving mobile ground robots and another involving a robotic manipulator -- which demonstrates that the architecture generalizes well to differing contexts. Comprehensive evaluations including deployment on a physical robot show that significantly improves on the accuracy of the previous method that utilizes traditional image processing and segmentation.


page 5

page 11


Sample-efficient Adversarial Imitation Learning

Imitation learning, in which learning is performed by demonstration, has...

REvolveR: Continuous Evolutionary Models for Robot-to-robot Policy Transfer

A popular paradigm in robotic learning is to train a policy from scratch...

Robot peels banana with goal-conditioned dual-action deep imitation learning

A long-horizon dexterous robot manipulation task of deformable objects, ...

Online Recognition of Actions Involving Objects

We present an online system for real time recognition of actions involvi...

Lyapunov-Net: A Deep Neural Network Architecture for Lyapunov Function Approximation

We develop a versatile deep neural network architecture, called Lyapunov...

Leveraging Haptic Feedback to Improve Data Quality and Quantity for Deep Imitation Learning Models

Learning from demonstration (LfD) is a proven technique to teach robots ...