Cable Routing and Assembly using Tactile-driven Motion Primitives

03/21/2023
by   Achu Wilson, et al.
0

Manipulating cables is challenging for robots because of the infinite degrees of freedom of the cables and frequent occlusion by the gripper and the environment. These challenges are further complicated by the dexterous nature of the operations required for cable routing and assembly, such as weaving and inserting, hampering common solutions with vision-only sensing. In this paper, we propose to integrate tactile-guided low-level motion control with high-level vision-based task parsing for a challenging task: cable routing and assembly on a reconfigurable task board. Specifically, we build a library of tactile-guided motion primitives using a fingertip GelSight sensor, where each primitive reliably accomplishes an operation such as cable following and weaving. The overall task is inferred via visual perception given a goal configuration image, and then used to generate the primitive sequence. Experiments demonstrate the effectiveness of individual tactile-guided primitives and the integrated end-to-end solution, significantly outperforming the method without tactile sensing. Our reconfigurable task setup and proposed baselines provide a benchmark for future research in cable manipulation. More details and video are presented in <https://helennn.github.io/cable-manip/>

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

research
03/10/2023

Tactile-Filter: Interactive Tactile Perception for Part Mating

Humans rely on touch and tactile sensing for a lot of dexterous manipula...
research
03/12/2023

StereoTac: a Novel Visuotactile Sensor that Combines Tactile Sensing with 3D Vision

Combining 3D vision with tactile sensing could unlock a greater level of...
research
12/02/2019

Surface Following using Deep Reinforcement Learning and a GelSightTactile Sensor

Tactile sensors can provide detailed contact in-formation that can facil...
research
09/21/2023

See to Touch: Learning Tactile Dexterity through Visual Incentives

Equipping multi-fingered robots with tactile sensing is crucial for achi...
research
07/22/2022

Learning to Singulate Layers of Cloth using Tactile Feedback

Robotic manipulation of cloth has applications ranging from fabrics manu...
research
03/08/2021

Benchmarking Off-The-Shelf Solutions to Robotic Assembly Tasks

In recent years, many learning based approaches have been studied to rea...

Please sign up or login with your details

Forgot password? Click here to reset