A Deep Reinforcement Learning Approach for Global Routing

06/20/2019
by   Haiguang Liao, et al.
19

Global routing has been a historically challenging problem in electronic circuit design, where the challenge is to connect a large and arbitrary number of circuit components with wires without violating the design rules for the printed circuit boards or integrated circuits. Similar routing problems also exist in the design of complex hydraulic systems, pipe systems and logistic networks. Existing solutions typically consist of greedy algorithms and hard-coded heuristics. As such, existing approaches suffer from a lack of model flexibility and non-optimum solutions. As an alternative approach, this work presents a deep reinforcement learning method for solving the global routing problem in a simulated environment. At the heart of the proposed method is deep reinforcement learning that enables an agent to produce an optimal policy for routing based on the variety of problems it is presented with leveraging the conjoint optimization mechanism of deep reinforcement learning. Conjoint optimization mechanism is explained and demonstrated in details; the best network structure and the parameters of the learned model are explored. Based on the fine-tuned model, routing solutions and rewards are presented and analyzed. The results indicate that the approach can outperform the benchmark method of a sequential A* method, suggesting a promising potential for deep reinforcement learning for global routing and other routing or path planning problems in general. Another major contribution of this work is the development of a global routing problem sets generator with the ability to generate parameterized global routing problem sets with different size and constraints, enabling evaluation of different routing algorithms and the generation of training datasets for future data-driven routing approaches.

READ FULL TEXT

page 5

page 6

page 9

page 12

page 15

page 16

research
10/08/2021

Ranking Cost: Building An Efficient and Scalable Circuit Routing Planner with Evolution-Based Optimization

Circuit routing has been a historically challenging problem in designing...
research
09/20/2017

A Deep-Reinforcement Learning Approach for Software-Defined Networking Routing Optimization

In this paper we design and evaluate a Deep-Reinforcement Learning agent...
research
06/24/2020

Circuit Routing Using Monte Carlo Tree Search and Deep Neural Networks

Circuit routing is a fundamental problem in designing electronic systems...
research
04/20/2020

Attention Routing: track-assignment detailed routing using attention-based reinforcement learning

In the physical design of integrated circuits, global and detailed routi...
research
10/18/2022

O Problema do Roteamento de Interligações Elétricas em Circuitos Integrados

Integrated circuit design automation tools are essential for the feasibi...
research
12/06/2019

Deep Reinforcement Learning for Routing a Heterogeneous Fleet of Vehicles

Motivated by the promising advances of deep-reinforcement learning (DRL)...
research
08/04/2020

Optimum Reconfiguration of Routing Interconnection Network in APSoC Fabrics

This paper presents an automated algorithm for optimum configuration of ...

Please sign up or login with your details

Forgot password? Click here to reset