The Scattering Compositional Learner: Discovering Objects, Attributes, Relationships in Analogical Reasoning

07/08/2020
by   Yuhuai Wu, et al.
1

In this work, we focus on an analogical reasoning task that contains rich compositional structures, Raven's Progressive Matrices (RPM). To discover compositional structures of the data, we propose the Scattering Compositional Learner (SCL), an architecture that composes neural networks in a sequence. Our SCL achieves state-of-the-art performance on two RPM datasets, with a 48.7 relative improvement on Balanced-RAVEN and 26.4 state-of-the-art. We additionally show that our model discovers compositional representations of objects' attributes (e.g., shape color, size), and their relationships (e.g., progression, union). We also find that the compositional representation makes the SCL significantly more robust to test-time domain shifts and greatly improves zero-shot generalization to previously unseen analogies.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/29/2023

Learning Conditional Attributes for Compositional Zero-Shot Learning

Compositional Zero-Shot Learning (CZSL) aims to train models to recogniz...
research
08/22/2022

Reference-Limited Compositional Zero-Shot Learning

Compositional zero-shot learning (CZSL) refers to recognizing unseen com...
research
05/03/2021

Learning Graph Embeddings for Open World Compositional Zero-Shot Learning

Compositional Zero-Shot learning (CZSL) aims to recognize unseen composi...
research
09/22/2021

COVR: A test-bed for Visually Grounded Compositional Generalization with real images

While interest in models that generalize at test time to new composition...
research
07/20/2016

Compositional Sequence Labeling Models for Error Detection in Learner Writing

In this paper, we present the first experiments using neural network mod...
research
05/26/2023

Im-Promptu: In-Context Composition from Image Prompts

Large language models are few-shot learners that can solve diverse tasks...
research
01/21/2015

A Graph Theoretic Approach for Object Shape Representation in Compositional Hierarchies Using a Hybrid Generative-Descriptive Model

A graph theoretic approach is proposed for object shape representation i...

Please sign up or login with your details

Forgot password? Click here to reset