Classification of Household Materials via Spectroscopy

05/10/2018
by   Zackory Erickson, et al.
2

Recognizing an object's material can inform a robot on how hard it may grasp the object during manipulation, or if the object may be safely heated up. To estimate an object's material during manipulation, many prior works have explored the use of haptic sensing. In this paper, we explore a technique for robots to estimate the materials of objects using spectroscopy. We demonstrate that spectrometers provide several benefits for material recognition, including fast sensing times and accurate measurements with low noise. Furthermore, spectrometers do not require direct contact with an object. To illustrate this, we collected a dataset of spectral measurements from two commercially available spectrometers during which a robotic platform interacted with 50 distinct objects, and we show that a residual neural network can accurately analyze these measurements. Due to the low variance in consecutive spectral measurements, our model achieved a material classification accuracy of 97.7 when given only one spectral sample per object. Similar to prior works with haptic sensors, we found that generalizing material recognition to new objects posed a greater challenge, for which we achieved an accuracy of 81.4 leave-one-object-out cross-validation. From this work, we find that spectroscopy poses a promising approach for further research in material classification during robotic manipulation.

READ FULL TEXT

page 1

page 3

page 4

page 7

research
04/02/2020

Multimodal Material Classification for Robots using Spectroscopy and High Resolution Texture Imaging

Material recognition can help inform robots about how to properly intera...
research
09/08/2022

RGB-X Classification for Electronics Sorting

Effectively disassembling and recovering materials from waste electrical...
research
07/03/2022

Pregrasp Object Material Classification by a Novel Gripper Design with Integrated Spectroscopy

Robots benefit from being able to classify objects they interact with or...
research
10/10/2022

SLURP! Spectroscopy of Liquids Using Robot Pre-Touch Sensing

Liquids and granular media are pervasive throughout human environments. ...
research
09/15/2023

RaSpectLoc: RAman SPECTroscopy-dependent robot LOCalisation

This paper presents a new information source for supporting robot locali...
research
05/16/2023

Revisiting Proprioceptive Sensing for Articulated Object Manipulation

Robots that assist humans will need to interact with articulated objects...
research
12/03/2020

Material Recognition via Heat Transfer Given Ambiguous Initial Conditions

Humans and robots can recognize materials with distinct thermal effusivi...

Please sign up or login with your details

Forgot password? Click here to reset