Symmetric Models for Visual Force Policy Learning

08/28/2023
by   Colin Kohler, et al.
0

While it is generally acknowledged that force feedback is beneficial to robotic control, applications of policy learning to robotic manipulation typically only leverage visual feedback. Recently, symmetric neural models have been used to significantly improve the sample efficiency and performance of policy learning across a variety of robotic manipulation domains. This paper explores an application of symmetric policy learning to visual-force problems. We present Symmetric Visual Force Learning (SVFL), a novel method for robotic control which leverages visual and force feedback. We demonstrate that SVFL can significantly outperform state of the art baselines for visual force learning and report several interesting empirical findings related to the utility of learning force feedback control policies in both general manipulation tasks and scenarios with low visual acuity.

READ FULL TEXT

page 7

page 8

page 12

page 13

page 17

research
02/17/2022

Multi-Modal Fusion in Contact-Rich Precise Tasks via Hierarchical Policy Learning

Combined visual and force feedback play an essential role in contact-ric...
research
11/16/2018

Increasing Impact by Mechanical Resonance for Teleoperated Hammering

Series elastic actuators (SEAs) are interesting for usage in harsh envir...
research
11/15/2022

Deep Instance Segmentation and Visual Servoing to Play Jenga with a Cost-Effective Robotic System

The game of Jenga represents an inspiring benchmark for developing innov...
research
01/22/2023

Immersive Demonstrations are the Key to Imitation Learning

Achieving successful robotic manipulation is an essential step towards r...
research
09/21/2023

ForceSight: Text-Guided Mobile Manipulation with Visual-Force Goals

We present ForceSight, a system for text-guided mobile manipulation that...
research
03/08/2022

SO(2)-Equivariant Reinforcement Learning

Equivariant neural networks enforce symmetry within the structure of the...
research
05/18/2010

Multi-sensorial interaction with a nano-scale phenomenon : the force curve

Using Atomic Force Microscopes (AFM) to manipulate nano-objects is an ac...

Please sign up or login with your details

Forgot password? Click here to reset