Visuo-Haptic Object Perception for Robots: An Overview

This article summarizes the current state of multimodal object perception for robotic applications. It covers aspects of biological inspiration, sensor technologies, data sets, and sensory data processing for object recognition and grasping. Firstly, the biological basis of multimodal object perception is outlined. Then the sensing technologies and data collection strategies are discussed. Next, an introduction to the main computational aspects is presented, highlighting a few representative articles for each main application area, including object recognition, object manipulation and grasping, texture recognition, and transfer learning. Finally, informed by the current advancements in each area, this article outlines promising new research directions.

READ FULL TEXT

page 4

page 8

page 9

research
02/08/2022

Robotic Grasping from Classical to Modern: A Survey

Robotic Grasping has always been an active topic in robotics since grasp...
research
07/29/2013

Integration of 3D Object Recognition and Planning for Robotic Manipulation: A Preliminary Report

We investigate different approaches to integrating object recognition an...
research
12/13/2020

Vision Based Adaptation to Kernelized Synergies for Human Inspired Robotic Manipulation

Humans in contrast to robots are excellent in performing fine manipulati...
research
12/27/2021

AU Dataset for Visuo-Haptic Object Recognition for Robots

Multimodal object recognition is still an emerging field. Thus, publicly...
research
09/16/2021

ObjectFolder: A Dataset of Objects with Implicit Visual, Auditory, and Tactile Representations

Multisensory object-centric perception, reasoning, and interaction have ...
research
08/03/2023

Active Acoustic Sensing for Robot Manipulation

Perception in robot manipulation has been actively explored with the goa...
research
06/19/2018

iCLAP: Shape Recognition by Combining Proprioception and Touch Sensing

For humans, both the proprioception and touch sensing are highly utilize...

Please sign up or login with your details

Forgot password? Click here to reset