Learning a Weight Map for Weakly-Supervised Localization

11/28/2021
by   Tal Shaharabany, et al.
0

In the weakly supervised localization setting, supervision is given as an image-level label. We propose to employ an image classifier f and to train a generative network g that outputs, given the input image, a per-pixel weight map that indicates the location of the object within the image. Network g is trained by minimizing the discrepancy between the output of the classifier f on the original image and its output given the same image weighted by the output of g. The scheme requires a regularization term that ensures that g does not provide a uniform weight, and an early stopping criterion in order to prevent g from over-segmenting the image. Our results indicate that the method outperforms existing localization methods by a sizable margin on the challenging fine-grained classification datasets, as well as a generic image recognition dataset. Additionally, the obtained weight map is also state-of-the-art in weakly supervised segmentation in fine-grained categorization datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 7

page 8

research
04/01/2022

Bridging the Gap between Classification and Localization for Weakly Supervised Object Localization

Weakly supervised object localization aims to find a target object regio...
research
06/20/2023

UM-CAM: Uncertainty-weighted Multi-resolution Class Activation Maps for Weakly-supervised Fetal Brain Segmentation

Accurate segmentation of the fetal brain from Magnetic Resonance Image (...
research
05/23/2021

Weakly Supervised Instance Attention for Multisource Fine-Grained Object Recognition with an Application to Tree Species Classification

Multisource image analysis that leverages complementary spectral, spatia...
research
04/05/2018

FPAN: Fine-grained and Progressive Attention Localization Network for Data Retrieval

The Localization of the target object for data retrieval is a key issue ...
research
11/29/2019

On the Benefits of Attributional Robustness

Interpretability is an emerging area of research in trustworthy machine ...
research
12/17/2022

Fully and Weakly Supervised Referring Expression Segmentation with End-to-End Learning

Referring Expression Segmentation (RES), which is aimed at localizing an...
research
09/30/2020

Self-Guided Multiple Instance Learning for Weakly Supervised Disease Classification and Localization in Chest Radiographs

The lack of fine-grained annotations hinders the deployment of automated...

Please sign up or login with your details

Forgot password? Click here to reset