Learning Compositional Representations for Few-Shot Recognition

12/21/2018
by   Pavel Tokmakov, et al.
10

One of the key limitations of modern deep learning based approaches lies in the amount of data required to train them. Humans, on the other hand, can learn to recognize novel categories from just a few examples. Instrumental to this rapid learning ability is the compositional structure of concept representations in the human brain - something that deep learning models are lacking. In this work we make a step towards bridging this gap between human and machine learning by introducing a simple regularization technique that allows the learned representation to be decomposable into parts. We evaluate the proposed approach on three datasets: CUB-200-2011, SUN397, and ImageNet, and demonstrate that our compositional representations require fewer examples to learn classifiers for novel categories, outperforming state-of-the-art few-shot learning approaches by a significant margin.

READ FULL TEXT

page 1

page 5

page 14

research
06/09/2016

Low-shot Visual Recognition by Shrinking and Hallucinating Features

Low-shot visual learning---the ability to recognize novel object categor...
research
05/14/2021

Visual analogy: Deep learning versus compositional models

Is analogical reasoning a task that must be learned to solve from scratc...
research
06/11/2019

Weakly-supervised Compositional FeatureAggregation for Few-shot Recognition

Learning from a few examples is a challenging task for machine learning....
research
10/27/2017

One-shot and few-shot learning of word embeddings

Standard deep learning systems require thousands or millions of examples...
research
04/14/2020

Few-Shot Single-View 3-D Object Reconstruction with Compositional Priors

The impressive performance of deep convolutional neural networks in sing...
research
02/14/2018

Learning Deep Disentangled Embeddings with the F-Statistic Loss

Deep-embedding methods aim to discover representations of a domain that ...
research
05/20/2021

Flexible Compositional Learning of Structured Visual Concepts

Humans are highly efficient learners, with the ability to grasp the mean...

Please sign up or login with your details

Forgot password? Click here to reset