Knowledge-Guided Object Discovery with Acquired Deep Impressions

03/19/2021
by   Jinyang Yuan, et al.
0

We present a framework called Acquired Deep Impressions (ADI) which continuously learns knowledge of objects as "impressions" for compositional scene understanding. In this framework, the model first acquires knowledge from scene images containing a single object in a supervised manner, and then continues to learn from novel multi-object scene images which may contain objects that have not been seen before without any further supervision, under the guidance of the learned knowledge as humans do. By memorizing impressions of objects into parameters of neural networks and applying the generative replay strategy, the learned knowledge can be reused to generate images with pseudo-annotations and in turn assist the learning of novel scenes. The proposed ADI framework focuses on the acquisition and utilization of knowledge, and is complementary to existing deep generative models proposed for compositional scene representation. We adapt a base model to make it fall within the ADI framework and conduct experiments on two types of datasets. Empirical results suggest that the proposed framework is able to effectively utilize the acquired impressions and improve the scene decomposition performance.

READ FULL TEXT

page 3

page 5

page 7

page 18

page 19

page 20

page 21

page 22

research
12/07/2021

Unsupervised Learning of Compositional Scene Representations from Multiple Unspecified Viewpoints

Visual scenes are extremely rich in diversity, not only because there ar...
research
10/17/2018

A Case for Object Compositionality in Deep Generative Models of Images

Deep generative models seek to recover the process with which the observ...
research
06/11/2020

Learning to Infer 3D Object Models from Images

A crucial ability of human intelligence is to build up models of individ...
research
02/15/2022

Compositional Scene Representation Learning via Reconstruction: A Survey

Visual scene representation learning is an important research problem in...
research
03/28/2016

Attend, Infer, Repeat: Fast Scene Understanding with Generative Models

We present a framework for efficient inference in structured image model...
research
06/02/2022

Leveraging Systematic Knowledge of 2D Transformations

The existing deep learning models suffer from out-of-distribution (o.o.d...
research
05/23/2023

NCHO: Unsupervised Learning for Neural 3D Composition of Humans and Objects

Deep generative models have been recently extended to synthesizing 3D di...

Please sign up or login with your details

Forgot password? Click here to reset