Teraflop-scale Incremental Machine Learning

03/05/2011
by   Eray Özkural, et al.
0

We propose a long-term memory design for artificial general intelligence based on Solomonoff's incremental machine learning methods. We use R5RS Scheme and its standard library with a few omissions as the reference machine. We introduce a Levin Search variant based on Stochastic Context Free Grammar together with four synergistic update algorithms that use the same grammar as a guiding probability distribution of programs. The update algorithms include adjusting production probabilities, re-using previous solutions, learning programming idioms and discovery of frequent subprograms. Experiments with two training sequences demonstrate that our approach to incremental learning is effective.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/08/2017

Gigamachine: incremental machine learning on desktop computers

We present a concrete design for Solomonoff's incremental machine learni...
research
12/01/2022

P(Expression|Grammar): Probability of deriving an algebraic expression with a probabilistic context-free grammar

Probabilistic context-free grammars have a long-term record of use as ge...
research
10/10/2018

Incremental SAT Library Integration Using Abstract Stobjs

We describe an effort to soundly use off-the-shelf incremental SAT solve...
research
01/21/2021

Commutative Event Sourcing vs. Triple Graph Grammars

This paper proposes Commutative Event Sourcing as a simple and reliable ...
research
10/02/2021

Minimizing LR(1) State Machines is NP-Hard

LR(1) parsing was a focus of extensive research in the past 50 years. Th...
research
08/30/2022

BioSLAM: A Bio-inspired Lifelong Memory System for General Place Recognition

We present BioSLAM, a lifelong SLAM framework for learning various new a...
research
04/27/2019

Incremental personalized E-mail spam filter using novel TFDCR feature selection with dynamic feature update

Communication through e-mails remains to be highly formalized, conventio...

Please sign up or login with your details

Forgot password? Click here to reset