P(Expression|Grammar): Probability of deriving an algebraic expression with a probabilistic context-free grammar

12/01/2022
by   Urh Primožič, et al.
0

Probabilistic context-free grammars have a long-term record of use as generative models in machine learning and symbolic regression. When used for symbolic regression, they generate algebraic expressions. We define the latter as equivalence classes of strings derived by grammar and address the problem of calculating the probability of deriving a given expression with a given grammar. We show that the problem is undecidable in general. We then present specific grammars for generating linear, polynomial, and rational expressions, where algorithms for calculating the probability of a given expression exist. For those grammars, we design algorithms for calculating the exact probability and efficient approximation with arbitrary precision.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/15/2020

Learning of Structurally Unambiguous Probabilistic Grammars

The problem of identifying a probabilistic context free grammar has two ...
research
06/04/2023

A Fast Algorithm for Computing Prefix Probabilities

Multiple algorithms are known for efficiently calculating the prefix pro...
research
03/05/2011

Teraflop-scale Incremental Machine Learning

We propose a long-term memory design for artificial general intelligence...
research
04/30/2023

How to enumerate trees from a context-free grammar

I present a simple algorithm for enumerating the trees generated by a Co...
research
09/08/2017

Gigamachine: incremental machine learning on desktop computers

We present a concrete design for Solomonoff's incremental machine learni...
research
04/27/2023

Multiplicity Problems on Algebraic Series and Context-Free Grammars

In this paper we obtain complexity bounds for computational problems on ...
research
11/14/2018

Automatic Grammar Augmentation for Robust Voice Command Recognition

This paper proposes a novel pipeline for automatic grammar augmentation ...

Please sign up or login with your details

Forgot password? Click here to reset