A Short Survey of Systematic Generalization

11/22/2022
by   Yuanpeng Li, et al.
0

This survey includes systematic generalization and a history of how machine learning addresses it. We aim to summarize and organize the related information of both conventional and recent improvements. We first look at the definition of systematic generalization, then introduce Classicist and Connectionist. We then discuss different types of Connectionists and how they approach the generalization. Two crucial problems of variable binding and causality are discussed. We look into systematic generalization in language, vision, and VQA fields. Recent improvements from different aspects are discussed. Systematic generalization has a long history in artificial intelligence. We could cover only a small portion of many contributions. We hope this paper provides a background and is beneficial for discoveries in future work.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/15/2021

How Modular Should Neural Module Networks Be for Systematic Generalization?

Neural Module Networks (NMNs) aim at Visual Question Answering (VQA) via...
research
04/02/2019

The Impact of Systematic Edits in History Slicing

While extracting a subset of a commit history, specifying the necessary ...
research
10/11/2016

Survey on the Use of Typological Information in Natural Language Processing

In recent years linguistic typology, which classifies the world's langua...
research
08/24/2022

On a Built-in Conflict between Deep Learning and Systematic Generalization

In this paper, we hypothesize that internal function sharing is one of t...
research
08/31/2021

Towards Out-Of-Distribution Generalization: A Survey

Classic machine learning methods are built on the i.i.d. assumption that...
research
11/30/2018

Systematic Generalization: What Is Required and Can It Be Learned?

Numerous models for grounded language understanding have been recently p...
research
12/23/2018

Intelligent Tutoring Systems: A Comprehensive Historical Survey with Recent Developments

This paper provides interested beginners with an updated and detailed in...

Please sign up or login with your details

Forgot password? Click here to reset