ASOC: Adaptive Self-aware Object Co-localization

The primary goal of this paper is to localize objects in a group of semantically similar images jointly, also known as the object co-localization problem. Most related existing works are essentially weakly-supervised, relying prominently on the neighboring images' weak-supervision. Although weak supervision is beneficial, it is not entirely reliable, for the results are quite sensitive to the neighboring images considered. In this paper, we combine it with a self-awareness phenomenon to mitigate this issue. By self-awareness here, we refer to the solution derived from the image itself in the form of saliency cue, which can also be unreliable if applied alone. Nevertheless, combining these two paradigms together can lead to a better co-localization ability. Specifically, we introduce a dynamic mediator that adaptively strikes a proper balance between the two static solutions to provide an optimal solution. Therefore, we call this method ASOC: Adaptive Self-aware Object Co-localization. We perform exhaustive experiments on several benchmark datasets and validate that weak-supervision supplemented with self-awareness has superior performance outperforming several compared competing methods.

READ FULL TEXT

page 3

page 5

page 6

research
03/01/2016

Weakly Supervised Localization using Deep Feature Maps

Object localization is an important computer vision problem with a varie...
research
03/18/2023

Spatial-Aware Token for Weakly Supervised Object Localization

Weakly supervised object localization (WSOL) is a challenging task aimin...
research
03/03/2017

Bridging Saliency Detection to Weakly Supervised Object Detection Based on Self-paced Curriculum Learning

Weakly-supervised object detection (WOD) is a challenging problems in co...
research
01/21/2020

Evaluating Weakly Supervised Object Localization Methods Right

Weakly-supervised object localization (WSOL) has gained popularity over ...
research
07/08/2020

Evaluation for Weakly Supervised Object Localization: Protocol, Metrics, and Datasets

Weakly-supervised object localization (WSOL) has gained popularity over ...
research
07/11/2021

Towards Accurate Localization by Instance Search

Visual object localization is the key step in a series of object detecti...
research
08/03/2022

Integrating Object-aware and Interaction-aware Knowledge for Weakly Supervised Scene Graph Generation

Recently, increasing efforts have been focused on Weakly Supervised Scen...

Please sign up or login with your details

Forgot password? Click here to reset