PyTouch: A Machine Learning Library for Touch Processing

05/26/2021
by   Mike Lambeta, et al.
0

With the increased availability of rich tactile sensors, there is an equally proportional need for open-source and integrated software capable of efficiently and effectively processing raw touch measurements into high-level signals that can be used for control and decision-making. In this paper, we present PyTouch – the first machine learning library dedicated to the processing of touch sensing signals. PyTouch, is designed to be modular, easy-to-use and provides state-of-the-art touch processing capabilities as a service with the goal of unifying the tactile sensing community by providing a library for building scalable, proven, and performance-validated modules over which applications and research can be built upon. We evaluate PyTouch on real-world data from several tactile sensors on touch processing tasks such as touch detection, slip and object pose estimations. PyTouch is open-sourced at https://github.com/facebookresearch/pytouch .

READ FULL TEXT

page 4

page 6

research
06/09/2023

Augmenting Off-the-Shelf Grippers with Tactile Sensing

The development of tactile sensing and its fusion with computer vision i...
research
12/15/2020

TACTO: A Fast, Flexible and Open-source Simulator for High-Resolution Vision-based Tactile Sensors

Simulators perform an important role in prototyping, debugging and bench...
research
09/11/2023

Seamless Integration of Tactile Sensors for Cobots

The development of tactile sensing is expected to enhance robotic system...
research
02/19/2022

Learning to Detect Slip with Barometric Tactile Sensors and a Temporal Convolutional Neural Network

The ability to perceive object slip via tactile feedback enables humans ...
research
04/20/2021

MBRL-Lib: A Modular Library for Model-based Reinforcement Learning

Model-based reinforcement learning is a compelling framework for data-ef...
research
04/24/2018

Open Tactile - An open, modular hardware system for controlling tactile displays

Tactile displays have a wide potential field of applications, ranging fr...
research
06/15/2021

A General Purpose Transpiler for Fully Homomorphic Encryption

Fully homomorphic encryption (FHE) is an encryption scheme which enables...

Please sign up or login with your details

Forgot password? Click here to reset