Fine-grained Few-shot Recognition by Deep Object Parsing

07/14/2022
by   Pengkai Zhu, et al.
15

In our framework, an object is made up of K distinct parts or units, and we parse a test instance by inferring the K parts, where each part occupies a distinct location in the feature space, and the instance features at this location, manifest as an active subset of part templates shared across all instances. We recognize test instances by comparing its active templates and the relative geometry of its part locations against those of the presented few-shot instances. We propose an end-to-end training method to learn part templates on-top of a convolutional backbone. To combat visual distortions such as orientation, pose and size, we learn multi-scale templates, and at test-time parse and match instances across these scales. We show that our method is competitive with the state-of-the-art, and by virtue of parsing enjoys interpretability as well.

READ FULL TEXT

page 12

page 13

page 14

research
08/03/2018

Parsing Geometry Using Structure-Aware Shape Templates

Real-life man-made objects often exhibit strong and easily-identifiable ...
research
07/15/2014

Part-based R-CNNs for Fine-grained Category Detection

Semantic part localization can facilitate fine-grained categorization by...
research
09/14/2015

Expanded Parts Model for Semantic Description of Humans in Still Images

We introduce an Expanded Parts Model (EPM) for recognizing human attribu...
research
11/30/2018

Parsing R-CNN for Instance-Level Human Analysis

Instance-level human analysis is common in real-life scenarios and has m...
research
12/01/2021

AdaAfford: Learning to Adapt Manipulation Affordance for 3D Articulated Objects via Few-shot Interactions

Perceiving and interacting with 3D articulated objects, such as cabinets...
research
05/04/2021

End-to-end One-shot Human Parsing

Previous human parsing models are limited to parsing humans into pre-def...
research
01/19/2021

Integrated Visualization Editing via Parameterized Declarative Templates

Interfaces for creating visualizations typically embrace one of several ...

Please sign up or login with your details

Forgot password? Click here to reset