Single-Shot Clothing Category Recognition in Free-Configurations with Application to Autonomous Clothes Sorting

07/22/2017
by   Li Sun, et al.
0

This paper proposes a single-shot approach for recognising clothing categories from 2.5D features. We propose two visual features, BSP (B-Spline Patch) and TSD (Topology Spatial Distances) for this task. The local BSP features are encoded by LLC (Locality-constrained Linear Coding) and fused with three different global features. Our visual feature is robust to deformable shapes and our approach is able to recognise the category of unknown clothing in unconstrained and random configurations. We integrated the category recognition pipeline with a stereo vision system, clothing instance detection, and dual-arm manipulators to achieve an autonomous sorting system. To verify the performance of our proposed method, we build a high-resolution RGBD clothing dataset of 50 clothing items of 5 categories sampled in random configurations (a total of 2,100 clothing samples). Experimental results show that our approach is able to reach 83.2% accuracy while classifying clothing items which were previously unseen during training. This advances beyond the previous state-of-the-art by 36.2%. Finally, we evaluate the proposed approach in an autonomous robot sorting system, in which the robot recognises a clothing item from an unconstrained pile, grasps it, and sorts it into a box according to its category. Our proposed sorting system achieves reasonable sorting success rates with single-shot perception.

READ FULL TEXT

page 2

page 3

page 6

research
10/18/2016

Robot Vision Architecture for Autonomous Clothes Manipulation

This paper presents a novel robot vision architecture for perceiving gen...
research
08/29/2022

A Data-Centric Approach For Dual-Arm Robotic Garment Flattening

Due to the high dimensionality of object states, a garment flattening pi...
research
07/14/2020

Top-Related Meta-Learning Method for Few-Shot Detection

Many meta-learning methods which depend on a large amount of data and mo...
research
06/12/2017

Few-Shot Image Recognition by Predicting Parameters from Activations

In this paper, we are interested in the few-shot learning problem. In pa...
research
11/26/2021

PicArrange – Visually Sort, Search, and Explore Private Images on a Mac Computer

The native macOS application PicArrange integrates state-of-the-art imag...
research
09/15/2023

AnyOKP: One-Shot and Instance-Aware Object Keypoint Extraction with Pretrained ViT

Towards flexible object-centric visual perception, we propose a one-shot...

Please sign up or login with your details

Forgot password? Click here to reset