DeepAI AI Chat
Log In Sign Up

Probabilistic Grammars for Equation Discovery

12/01/2020
by   Jure Brence, et al.
0

Equation discovery, also known as symbolic regression, is a type of automated modeling that discovers scientific laws, expressed in the form of equations, from observed data and expert knowledge. Deterministic grammars, such as context-free grammars, have been used to limit the search spaces in equation discovery by providing hard constraints that specify which equations to consider and which not. In this paper, we propose the use of probabilistic context-free grammars in the context of equation discovery. Such grammars encode soft constraints on the space of equations, specifying a prior probability distribution on the space of possible equations. We show that probabilistic grammars can be used to elegantly and flexibly formulate the parsimony principle, that favors simpler equations, through probabilities attached to the rules in the grammars. We demonstrate that the use of probabilistic, rather than deterministic grammars, in the context of a Monte-Carlo algorithm for grammar-based equation discovery, leads to more efficient equation discovery. Finally, by specifying prior probability distributions over equation spaces, the foundations are laid for Bayesian approaches to equation discovery.

READ FULL TEXT

page 1

page 2

page 3

page 4

01/30/2020

Data-Driven Discovery of Coarse-Grained Equations

A general method for learning probability density function (PDF) equatio...
12/05/2020

Data-based Discovery of Governing Equations

Most common mechanistic models are traditionally presented in mathematic...
04/17/2021

Automated Mathematical Equation Structure Discovery for Visual Analysis

Finding the best mathematical equation to deal with the different challe...
05/24/2021

A Flawed Dataset for Symbolic Equation Verification

Arabshahi, Singh, and Anandkumar (2018) propose a method for creating a ...
02/21/2021

Symbolic regression for scientific discovery: an application to wind speed forecasting

Symbolic regression corresponds to an ensemble of techniques that allow ...
05/25/2019

Application and Computation of Probabilistic Neural Plasticity

The discovery of neural plasticity has proved that throughout the life o...
03/05/2011

Teraflop-scale Incremental Machine Learning

We propose a long-term memory design for artificial general intelligence...