DeepAI AI Chat
Log In Sign Up

Weakly-supervised Any-shot Object Detection

by   Siddhesh Khandelwal, et al.
The University of British Columbia

Methods for object detection and segmentation rely on large scale instance-level annotations for training, which are difficult and time-consuming to collect. Efforts to alleviate this look at varying degrees and quality of supervision. Weakly-supervised approaches draw on image-level labels to build detectors/segmentors, while zero/few-shot methods assume abundant instance-level data for a set of base classes, and none to a few examples for novel classes. This taxonomy has largely siloed algorithmic designs. In this work, we aim to bridge this divide by proposing an intuitive weakly-supervised model that is applicable to a range of supervision: from zero to a few instance-level samples per novel class. For base classes, our model learns a mapping from weakly-supervised to fully-supervised detectors/segmentors. By learning and leveraging visual and lingual similarities between the novel and base classes, we transfer those mappings to obtain detectors/segmentors for novel classes; refining them with a few novel class instance-level annotated samples, if available. The overall model is end-to-end trainable and highly flexible. Through extensive experiments on MS-COCO and Pascal VOC benchmark datasets we show improved performance in a variety of settings.


page 7

page 16

page 17

page 18

page 19


Scaling Novel Object Detection with Weakly Supervised Detection Transformers

Weakly supervised object detection (WSOD) enables object detectors to be...

Many-shot from Low-shot: Learning to Annotate using Mixed Supervision for Object Detection

Object detection has witnessed significant progress by relying on large,...

Active Learning Strategies for Weakly-supervised Object Detection

Object detectors trained with weak annotations are affordable alternativ...

What Can Human Sketches Do for Object Detection?

Sketches are highly expressive, inherently capturing subjective and fine...

Weakly Supervised Object Detection in Artworks

We propose a method for the weakly supervised detection of objects in pa...

A Taught-Obesrve-Ask (TOA) Method for Object Detection with Critical Supervision

Being inspired by child's learning experience - taught first and followe...

Weakly-Supervised End-to-End CAD Retrieval to Scan Objects

CAD model retrieval to real-world scene observations has shown strong pr...