Garment Similarity Network (GarNet): A Continuous Perception Robotic Approach for Predicting Shapes and Visually Perceived Weights of Unseen Garments

09/16/2021
by   Li Duan, et al.
0

We present in this paper a Garment Similarity Network (GarNet) that learns geometric and physical similarities between known garments by continuously observing a garment while a robot picks it up from a table. The aim is to capture and encode geometric and physical characteristics of a garment into a manifold where a decision can be carried out, such as predicting the garment's shape class and its visually perceived weight. Our approach features an early stop strategy, which means that GarNet does not need to observe the entire video sequence to make a prediction and maintain high prediction accuracy values. In our experiments, we find that GarNet achieves prediction accuracies of 98 approach with state-of-art methods, and we observe that our approach advances the state-of-art methods from 70.8

READ FULL TEXT

page 1

page 3

research
11/11/2020

Continuous Perception for Classifying Shapes and Weights of Garmentsfor Robotic Vision Applications

We present an approach to continuous perception for robotic laundry task...
research
04/21/2023

Combining Vision and Tactile Sensation for Video Prediction

In this paper, we explore the impact of adding tactile sensation to vide...
research
08/22/2019

Learning Similarity Conditions Without Explicit Supervision

Many real-world tasks require models to compare images along multiple si...
research
07/03/2018

Deep Neural Object Analysis by Interactive Auditory Exploration with a Humanoid Robot

We present a novel approach for interactive auditory object analysis wit...
research
12/09/2022

Predicting Shape Development: a Riemannian Method

Predicting the future development of an anatomical shape from a single b...
research
07/11/2023

PePNet: A Periodicity-Perceived Workload Prediction Network Supporting Rare Occurrence of Heavy Workload

Cloud providers can greatly benefit from accurate workload prediction. H...

Please sign up or login with your details

Forgot password? Click here to reset