Class-Agnostic Counting

11/01/2018
by   Erika Lu, et al.
8

Nearly all existing counting methods are designed for a specific object class. Our work, however, aims to create a counting model able to count any class of object. To achieve this goal, we formulate counting as a matching problem, enabling us to exploit the image self-similarity property that naturally exists in object counting problems. We make the following three contributions: first, a Generic Matching Network (GMN) architecture that can potentially count any object in a class-agnostic manner; second, by reformulating the counting problem as one of matching objects, we can take advantage of the abundance of video data labeled for tracking, which contains natural repetitions suitable for training a counting model. Such data enables us to train the GMN. Third, to customize the GMN to different user requirements, an adapter module is used to specialize the model with minimal effort, i.e. using a few labeled examples, and adapting only a small fraction of the trained parameters. This is a form of few-shot learning, which is practical for domains where labels are limited due to requiring expert knowledge (e.g. microbiology). We demonstrate the flexibility of our method on a diverse set of existing counting benchmarks: specifically cells, cars, and human crowds. The model achieves competitive performance on cell and crowd counting datasets, and surpasses the state-of-the-art on the car dataset using only three training images. When training on the entire dataset, the proposed method outperforms all previous methods by a large margin.

READ FULL TEXT

page 2

page 7

page 10

page 11

page 13

page 15

research
01/22/2022

Iterative Correlation-based Feature Refinement for Few-shot Counting

Few-shot counting aims to count objects of any class in an image given o...
research
11/16/2021

Single Image Object Counting and Localizing using Active-Learning

The need to count and localize repeating objects in an image arises in d...
research
12/29/2022

A Unified Object Counting Network with Object Occupation Prior

The counting task, which plays a fundamental rule in numerous applicatio...
research
11/15/2017

People, Penguins and Petri Dishes: Adapting Object Counting Models To New Visual Domains And Object Types Without Forgetting

In this paper we propose a technique to adapt a convolutional neural net...
research
09/14/2016

A Large Contextual Dataset for Classification, Detection and Counting of Cars with Deep Learning

We have created a large diverse set of cars from overhead images, which ...
research
06/02/2023

Open-world Text-specified Object Counting

Our objective is open-world object counting in images, where the target ...
research
03/16/2022

Represent, Compare, and Learn: A Similarity-Aware Framework for Class-Agnostic Counting

Class-agnostic counting (CAC) aims to count all instances in a query ima...

Please sign up or login with your details

Forgot password? Click here to reset