On Learning to Prove

by   Daniel Huang, et al.

In this paper, we consider the problem of learning a (first-order) theorem prover where we use a representation of beliefs in mathematical claims instead of a proof system to search for proofs. The inspiration for doing so comes from the practices of human mathematicians where a proof system is typically used after the fact to justify a sequence of intuitive steps obtained by "plausible reasoning" rather than to discover them. Towards this end, we introduce a probabilistic representation of beliefs in first-order statements based on first-order distributive normal forms (dnfs) devised by the philosopher Jaakko Hintikka. Notably, the representation supports Bayesian update and does not enforce that logically equivalent statements are assigned the same probability---otherwise, we would end up in a circular situation where we require a prover in order to assign beliefs. We then examine (1) conjecturing as (statistical) model selection and (2) an alternating-turn proving game amenable (in principle) to self-play training to learn a prover that is both complete in the limit and sound provided that players maintain "reasonable" beliefs. Dnfs have super-exponential space requirements so the ideas in this paper should be taken as conducting a thought experiment on "learning to prove". As a step towards making the ideas practical, we will comment on how abstractions can be used to control the space requirements at the cost of completeness.


Logical Induction

We present a computable algorithm that assigns probabilities to every lo...

Verifying Quantum Phase Estimation (QPE) using Prove-It

The general-purpose interactive theorem-proving assistant called Prove-I...

Complete Conditional Type Structures (Extended Abstract)

Hierarchies of conditional beliefs (Battigalli and Siniscalchi 1999) pla...

Deep Network Guided Proof Search

Deep learning techniques lie at the heart of several significant AI adva...

Deduction Theorem: The Problematic Nature of Common Practice in Game Theory

We consider the Deduction Theorem that is used in the literature of game...

Order Effects in Bayesian Updates

Order effects occur when judgments about a hypothesis's probability give...

Please sign up or login with your details

Forgot password? Click here to reset