Open-World Weakly-Supervised Object Localization

by   Jinheng Xie, et al.

While remarkable success has been achieved in weakly-supervised object localization (WSOL), current frameworks are not capable of locating objects of novel categories in open-world settings. To address this issue, we are the first to introduce a new weakly-supervised object localization task called OWSOL (Open-World Weakly-Supervised Object Localization). During training, all labeled data comes from known categories and, both known and novel categories exist in the unlabeled data. To handle such data, we propose a novel paradigm of contrastive representation co-learning using both labeled and unlabeled data to generate a complete G-CAM (Generalized Class Activation Map) for object localization, without the requirement of bounding box annotation. As no class label is available for the unlabelled data, we conduct clustering over the full training set and design a novel multiple semantic centroids-driven contrastive loss for representation learning. We re-organize two widely used datasets, i.e., ImageNet-1K and iNatLoc500, and propose OpenImages150 to serve as evaluation benchmarks for OWSOL. Extensive experiments demonstrate that the proposed method can surpass all baselines by a large margin. We believe that this work can shift the close-set localization towards the open-world setting and serve as a foundation for subsequent works. Code will be released at


page 1

page 2

page 4

page 7

page 8

page 12

page 13

page 14


Contrastive learning of Class-agnostic Activation Map for Weakly Supervised Object Localization and Semantic Segmentation

While class activation map (CAM) generated by image classification netwo...

Rethinking the Localization in Weakly Supervised Object Localization

Weakly supervised object localization (WSOL) is one of the most popular ...

Re-Attention Transformer for Weakly Supervised Object Localization

Weakly supervised object localization is a challenging task which aims t...

New Intent Discovery with Pre-training and Contrastive Learning

New intent discovery aims to uncover novel intent categories from user u...

Seeded Hierarchical Clustering for Expert-Crafted Taxonomies

Practitioners from many disciplines (e.g., political science) use expert...

Topological Structure Learning for Weakly-Supervised Out-of-Distribution Detection

Out-of-distribution (OOD) detection is the key to deploying models safel...

Box-based Refinement for Weakly Supervised and Unsupervised Localization Tasks

It has been established that training a box-based detector network can e...

Please sign up or login with your details

Forgot password? Click here to reset