DeepAI AI Chat
Log In Sign Up

Deep Reinforcement Learning for Solving the Heterogeneous Capacitated Vehicle Routing Problem

10/06/2021
by   Jingwen Li, et al.
National University of Singapore
Microsoft
Nanyang Technological University
The Chinese University of Hong Kong
6

Existing deep reinforcement learning (DRL) based methods for solving the capacitated vehicle routing problem (CVRP) intrinsically cope with homogeneous vehicle fleet, in which the fleet is assumed as repetitions of a single vehicle. Hence, their key to construct a solution solely lies in the selection of the next node (customer) to visit excluding the selection of vehicle. However, vehicles in real-world scenarios are likely to be heterogeneous with different characteristics that affect their capacity (or travel speed), rendering existing DRL methods less effective. In this paper, we tackle heterogeneous CVRP (HCVRP), where vehicles are mainly characterized by different capacities. We consider both min-max and min-sum objectives for HCVRP, which aim to minimize the longest or total travel time of the vehicle(s) in the fleet. To solve those problems, we propose a DRL method based on the attention mechanism with a vehicle selection decoder accounting for the heterogeneous fleet constraint and a node selection decoder accounting for the route construction, which learns to construct a solution by automatically selecting both a vehicle and a node for this vehicle at each step. Experimental results based on randomly generated instances show that, with desirable generalization to various problem sizes, our method outperforms the state-of-the-art DRL method and most of the conventional heuristics, and also delivers competitive performance against the state-of-the-art heuristic method, i.e., SISR. Additionally, the results of extended experiments demonstrate that our method is also able to solve CVRPLib instances with satisfactory performance.

READ FULL TEXT

page 1

page 11

page 14

10/06/2021

Heterogeneous Attentions for Solving Pickup and Delivery Problem via Deep Reinforcement Learning

Recently, there is an emerging trend to apply deep reinforcement learnin...
12/06/2019

Deep Reinforcement Learning for Routing a Heterogeneous Fleet of Vehicles

Motivated by the promising advances of deep-reinforcement learning (DRL)...
11/04/2021

Attacking Deep Reinforcement Learning-Based Traffic Signal Control Systems with Colluding Vehicles

The rapid advancements of Internet of Things (IoT) and artificial intell...
12/22/2021

A Deep Reinforcement Learning Approach for Solving the Traveling Salesman Problem with Drone

Reinforcement learning has recently shown promise in learning quality so...
04/25/2020

A State Aggregation Approach for Solving Knapsack Problem with Deep Reinforcement Learning

This paper proposes a Deep Reinforcement Learning (DRL) approach for sol...
09/13/2022

Learning to Solve Multiple-TSP with Time Window and Rejections via Deep Reinforcement Learning

We propose a manager-worker framework based on deep reinforcement learni...
07/04/2022

Solving the Traveling Salesperson Problem with Precedence Constraints by Deep Reinforcement Learning

This work presents solutions to the Traveling Salesperson Problem with p...