DexPilot: Vision Based Teleoperation of Dexterous Robotic Hand-Arm System

10/07/2019
by   Ankur Handa, et al.
20

Teleoperation offers the possibility of imparting robotic systems with sophisticated reasoning skills, intuition, and creativity to perform tasks. However, current teleoperation solutions for high degree-of-actuation (DoA), multi-fingered robots are generally cost-prohibitive, while low-cost offerings usually provide reduced degrees of control. Herein, a low-cost, vision based teleoperation system, DexPilot, was developed that allows for complete control over the full 23 DoA robotic system by merely observing the bare human hand. DexPilot enables operators to carry out a variety of complex manipulation tasks that go beyond simple pick-and-place operations. This allows for collection of high dimensional, multi-modality, state-action data that can be leveraged in the future to learn sensorimotor policies for challenging manipulation tasks. The system performance was measured through speed and reliability metrics across two human demonstrators on a variety of tasks. The videos of the experiments can be found at <https://sites.google.com/view/dex-pilot>.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 8

page 11

page 12

page 14

research
07/10/2017

Vision-Based Multi-Task Manipulation for Inexpensive Robots Using End-To-End Learning from Demonstration

In this paper, we propose a multi-task learning from demonstration metho...
research
04/27/2020

The Ingredients of Real-World Robotic Reinforcement Learning

The success of reinforcement learning for real world robotics has been, ...
research
03/11/2020

A Mobile Robot Hand-Arm Teleoperation System by Vision and IMU

In this paper, we present a multimodal mobile teleoperation system that ...
research
04/08/2019

Quasi-Direct Drive for Low-Cost Compliant Robotic Manipulation

Robots must cost less and be force-controlled to enable widespread, safe...
research
07/07/2023

Polybot: Training One Policy Across Robots While Embracing Variability

Reusing large datasets is crucial to scale vision-based robotic manipula...
research
10/28/2019

Design, Implementation and Evaluation of a Variable Stiffness Transradial Hand Prosthesis

We present the design, implementation, and experimental evaluation of a ...
research
07/18/2023

Multi-Stage Cable Routing through Hierarchical Imitation Learning

We study the problem of learning to perform multi-stage robotic manipula...

Please sign up or login with your details

Forgot password? Click here to reset