Towards Instance Segmentation with Object Priority: Prominent Object Detection and Recognition

by   Hamed R. Tavakoli, et al.

This manuscript introduces the problem of prominent object detection and recognition inspired by the fact that human seems to priorities perception of scene elements. The problem deals with finding the most important region of interest, segmenting the relevant item/object in that area, and assigning it an object class label. In other words, we are solving the three problems of saliency modeling, saliency detection, and object recognition under one umbrella. The motivation behind such a problem formulation is (1) the benefits to the knowledge representation-based vision pipelines, and (2) the potential improvements in emulating bio-inspired vision systems by solving these three problems together. We are foreseeing extending this problem formulation to fully semantically segmented scenes with instance object priority for high-level inferences in various applications including assistive vision. Along with a new problem definition, we also propose a method to achieve such a task. The proposed model predicts the most important area in the image, segments the associated objects, and labels them. The proposed problem and method are evaluated against human fixations, annotated segmentation masks, and object class categories. We define a chance level for each of the evaluation criterion to compare the proposed algorithm with. Despite the good performance of the proposed baseline, the overall evaluations indicate that the problem of prominent object detection and recognition is a challenging task that is still worth investigating further.


page 1

page 3

page 5

page 6

page 8


Object as Distribution

Object detection is a critical part of visual scene understanding. The r...

HyperFusion-Net: Densely Reflective Fusion for Salient Object Detection

Salient object detection (SOD), which aims to find the most important re...

Bridging Saliency Detection to Weakly Supervised Object Detection Based on Self-paced Curriculum Learning

Weakly-supervised object detection (WOD) is a challenging problems in co...

A Spacecraft Dataset for Detection, Segmentation and Parts Recognition

Virtually all aspects of modern life depend on space technology. Thanks ...

One-Shot Segmentation in Clutter

We tackle the problem of one-shot segmentation: finding and segmenting a...

Contrastive Object Detection Using Knowledge Graph Embeddings

Object recognition for the most part has been approached as a one-hot pr...

Causal Scene BERT: Improving object detection by searching for challenging groups of data

Modern computer vision applications rely on learning-based perception mo...