Continual General Chunking Problem and SyncMap

Humans possess an inherent ability to chunk sequences into their constituent parts. In fact, this ability is thought to bootstrap language skills to the learning of image patterns which might be a key to a more animal-like type of intelligence. Here, we propose a continual generalization of the chunking problem (an unsupervised problem), encompassing fixed and probabilistic chunks, discovery of temporal and causal structures and their continual variations. Additionally, we propose an algorithm called SyncMap that can learn and adapt to changes in the problem by creating a dynamic map which preserves the correlation between variables. Results of SyncMap suggest that the proposed algorithm learn near optimal solutions, despite the presence of many types of structures and their continual variation. When compared to Word2vec, PARSER and MRIL, SyncMap surpasses or ties with the best algorithm on 77% of the scenarios while being the second best in the remaing 33%.

READ FULL TEXT
research
08/13/2021

Continual Backprop: Stochastic Gradient Descent with Persistent Randomness

The Backprop algorithm for learning in neural networks utilizes two mech...
research
09/08/2022

nVFNet-RDC: Replay and Non-Local Distillation Collaboration for Continual Object Detection

Continual Learning (CL) focuses on developing algorithms with the abilit...
research
01/10/2023

From Continual Learning to Causal Discovery in Robotics

Reconstructing accurate causal models of dynamic systems from time-serie...
research
09/28/2022

Disentangling Transfer in Continual Reinforcement Learning

The ability of continual learning systems to transfer knowledge from pre...
research
06/23/2023

Maintaining Plasticity in Deep Continual Learning

Modern deep-learning systems are specialized to problem settings in whic...
research
06/18/2021

The Animal ID Problem: Continual Curation

Hoping to stimulate new research in individual animal identification fro...

Please sign up or login with your details

Forgot password? Click here to reset