Deep Learning for Surface Material Classification Using Haptic And Visual Information

12/21/2015
by   Haitian Zheng, et al.
0

When a user scratches a hand-held rigid tool across an object surface, an acceleration signal can be captured, which carries relevant information about the surface. More importantly, such a haptic signal is complementary to the visual appearance of the surface, which suggests the combination of both modalities for the recognition of the surface material. In this paper, we present a novel deep learning method dealing with the surface material classification problem based on a Fully Convolutional Network (FCN), which takes as input the aforementioned acceleration signal and a corresponding image of the surface texture. Compared to previous surface material classification solutions, which rely on a careful design of hand-crafted domain-specific features, our method automatically extracts discriminative features utilizing the advanced deep learning methodologies. Experiments performed on the TUM surface material database demonstrate that our method achieves state-of-the-art classification accuracy robustly and efficiently.

READ FULL TEXT

page 1

page 4

page 5

page 9

research
03/16/2020

Fabric Surface Characterization: Assessment of Deep Learning-based Texture Representations Using a Challenging Dataset

Tactile sensing or fabric hand plays a critical role in an individual's ...
research
08/13/2014

Learning Multi-Scale Representations for Material Classification

The recent progress in sparse coding and deep learning has made unsuperv...
research
09/20/2016

Transfer Learning for Material Classification using Convolutional Networks

Material classification in natural settings is a challenge due to comple...
research
01/05/2016

Crater Detection via Convolutional Neural Networks

Craters are among the most studied geomorphic features in the Solar Syst...
research
07/05/2020

Deep Learning based Dimple Detection for Quantitative Fractography

In this work, we try to address the challenging problem of dimple detect...
research
10/24/2019

Assisting human experts in the interpretation of their visual process: A case study on assessing copper surface adhesive potency

Deep Neural Networks are often though to lack interpretability due to th...
research
06/03/2020

Controls on the distribution of deep-sea sediments

Deep-sea sediments represent the largest geological deposit on Earth and...

Please sign up or login with your details

Forgot password? Click here to reset