Vision-Based Object Recognition in Indoor Environments Using Topologically Persistent Features

by   Ekta U. Samani, et al.

Object recognition in unseen indoor environments remains a challenging problem for visual perception of mobile robots. In this letter, we propose the use of topologically persistent features, which rely on the shape information of the objects, to address this challenge. In particular, we extract two kinds of features, namely, sparse persistence image (PI) and amplitude, by applying persistent homology to multi-directional height function-based filtrations of the cubical complexes representing the object segmentation maps. The features are then used to train a fully connected network for recognition. For performance evaluation, in addition to a widely-used shape dataset, we collect a new dataset comprising scene images from two different environments, namely, a living room and a mock warehouse. The scenes in both the environments include up to five different objects that are chosen from a given set of fourteen objects. The objects have varying poses and arrangements, and are imaged under different illumination conditions and camera poses. The recognition performance of our methods, which are trained using the living room images, remains relatively unaffected on the unseen warehouse images. In contrast, the performance of the state-of-the-art Faster R-CNN method decreases significantly. In fact, the use of sparse PI features yields higher overall recall and accuracy; and, better F1 scores on many of the individual object classes. We also implement the proposed method on a real-world robot to demonstrate its usefulness.


page 1

page 3

page 4

page 7


Persistent Homology Meets Object Unity: Object Recognition in Clutter

Recognition of occluded objects in unseen and unstructured indoor enviro...

Topologically Persistent Features-based Object Recognition in Cluttered Indoor Environments

Recognition of occluded objects in unseen indoor environments is a chall...

What's in my Room? Object Recognition on Indoor Panoramic Images

In the last few years, there has been a growing interest in taking advan...

Structural and object detection for phosphene images

Prosthetic vision based on phosphenes is a promising way to provide visu...

Object Recognition under Multifarious Conditions: A Reliability Analysis and A Feature Similarity-based Performance Estimation

In this paper, we investigate the reliability of online recognition plat...

Human-Inspired Topological Representations for Visual Object Recognition in Unseen Environments

Visual object recognition in unseen and cluttered indoor environments is...

Robust Structure Identification and Room Segmentation of Cluttered Indoor Environments from Occupancy Grid Maps

Identifying the environment's structure, i.e., to detect core components...

Please sign up or login with your details

Forgot password? Click here to reset