First-Order Problem Solving through Neural MCTS based Reinforcement Learning

01/11/2021
by   Ruiyang Xu, et al.
12

The formal semantics of an interpreted first-order logic (FOL) statement can be given in Tarskian Semantics or a basically equivalent Game Semantics. The latter maps the statement and the interpretation into a two-player semantic game. Many combinatorial problems can be described using interpreted FOL statements and can be mapped into a semantic game. Therefore, learning to play a semantic game perfectly leads to the solution of a specific instance of a combinatorial problem. We adapt the AlphaZero algorithm so that it becomes better at learning to play semantic games that have different characteristics than Go and Chess. We propose a general framework, Persephone, to map the FOL description of a combinatorial problem to a semantic game so that it can be solved through a neural MCTS based reinforcement learning algorithm. Our goal for Persephone is to make it tabula-rasa, mapping a problem stated in interpreted FOL to a solution without human intervention.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/10/2019

The far side of the cube

Game-semantic models usually start from the core model of the prototypic...
research
03/08/2019

Learning Self-Game-Play Agents for Combinatorial Optimization Problems

Recent progress in reinforcement learning (RL) using self-game-play has ...
research
01/26/2021

Investment vs. reward in a competitive knapsack problem

Natural selection drives species to develop brains, with sizes that incr...
research
10/15/2022

Reinforcement Learning for ConnectX

ConnectX is a two-player game that generalizes the popular game Connect ...
research
06/27/2019

A Game Model for Proofs with Costs

We look at substructural calculi from a game semantic point of view, gui...
research
03/24/2021

The combinatorial game nofil played on Steiner Triple Systems

We introduce an impartial combinatorial game on Steiner triple systems c...
research
08/25/2022

Turning Mathematics Problems into Games: Reinforcement Learning and Gröbner bases together solve Integer Feasibility Problems

Can agents be trained to answer difficult mathematical questions by play...

Please sign up or login with your details

Forgot password? Click here to reset