Reinforcement Learning-based Non-Autoregressive Solver for Traveling Salesman Problems

08/01/2023
by   Yubin Xiao, et al.
0

The Traveling Salesman Problem (TSP) is a well-known problem in combinatorial optimization with applications in various domains. However, existing TSP solvers face challenges in producing high-quality solutions with low latency. To address this issue, we propose NAR4TSP, which produces TSP solutions in a Non-Autoregressive (NAR) manner using a specially designed Graph Neural Network (GNN), achieving faster inference speed. Moreover, NAR4TSP is trained using an enhanced Reinforcement Learning (RL) strategy, eliminating the dependency on costly labels used to train conventional supervised learning-based NAR models. To the best of our knowledge, NAR4TSP is the first TSP solver that successfully combines RL and NAR decoding. The experimental results on both synthetic and real-world TSP instances demonstrate that NAR4TSP outperforms four state-of-the-art models in terms of solution quality, inference latency, and generalization ability. Lastly, we present visualizations of NAR4TSP's decoding process and its overall path planning to showcase the feasibility of implementing NAR4TSP in an end-to-end manner and its effectiveness, respectively.

READ FULL TEXT

page 1

page 6

page 11

research
02/14/2021

Reversible Action Design for Combinatorial Optimization with Reinforcement Learning

Combinatorial optimization problem (COP) over graphs is a fundamental ch...
research
01/25/2022

What's Wrong with Deep Learning in Tree Search for Combinatorial Optimization

Combinatorial optimization lies at the core of many real-world problems....
research
12/19/2020

Generalize a Small Pre-trained Model to Arbitrarily Large TSP Instances

For the traveling salesman problem (TSP), the existing supervised learni...
research
03/12/2020

Heterogeneous Relational Reasoning in Knowledge Graphs with Reinforcement Learning

Path-based relational reasoning over knowledge graphs has become increas...
research
08/08/2021

On the Difficulty of Generalizing Reinforcement Learning Framework for Combinatorial Optimization

Combinatorial optimization problems (COPs) on the graph with real-life a...
research
12/24/2021

An Efficient Combinatorial Optimization Model Using Learning-to-Rank Distillation

Recently, deep reinforcement learning (RL) has proven its feasibility in...
research
05/23/2022

DOGE-Train: Discrete Optimization on GPU with End-to-end Training

We present a fast, scalable, data-driven approach for solving linear rel...

Please sign up or login with your details

Forgot password? Click here to reset