NaturalProofs: Mathematical Theorem Proving in Natural Language

03/24/2021
by   Sean Welleck, et al.
0

Understanding and creating mathematics using natural mathematical language - the mixture of symbolic and natural language used by humans - is a challenging and important problem for driving progress in machine learning. As a step in this direction, we develop NaturalProofs, a large-scale dataset of mathematical statements and their proofs, written in natural mathematical language. Using NaturalProofs, we propose a mathematical reference retrieval task that tests a system's ability to determine the key results that appear in a proof. Large-scale sequence models excel at this task compared to classical information retrieval techniques, and benefit from language pretraining, yet their performance leaves substantial room for improvement. NaturalProofs opens many possibilities for future research on challenging mathematical tasks.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

02/03/2021

Learning to Match Mathematical Statements with Proofs

We introduce a novel task consisting in assigning a proof to a given mat...
04/30/2020

Natural Language Premise Selection: Finding Supporting Statements for Mathematical Text

Mathematical text is written using a combination of words and mathematic...
03/05/2021

Measuring Mathematical Problem Solving With the MATH Dataset

Many intellectual endeavors require mathematical problem solving, but th...
08/26/2021

A Statutory Article Retrieval Dataset in French

Statutory article retrieval is the task of automatically retrieving law ...
04/13/2021

Distilling Wikipedia mathematical knowledge into neural network models

Machine learning applications to symbolic mathematics are becoming incre...
11/14/2019

The RaPID-OMEGA system: Room and Proctor Intelligent Decider for large scale tests programming

We present the mathematical modeling for the problem of choosing rooms a...
02/08/2022

Natural Language Proof Checking in Introduction to Proof Classes – First Experiences with Diproche

We present and analyze the employment of the Diproche system, a natural ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.