Track-Assignment Detailed Routing Using Attention-based Policy Model With Supervision

10/26/2020
by   Haiguang Liao, et al.
0

Detailed routing is one of the most critical steps in analog circuit design. Complete routing has become increasingly more challenging in advanced node analog circuits, making advances in efficient automatic routers ever more necessary. In this work, we propose a machine learning driven method for solving the track-assignment detailed routing problem for advanced node analog circuits. Our approach adopts an attention-based reinforcement learning (RL) policy model. Our main insight and advancement over this RL model is the use of supervision as a way to leverage solutions generated by a conventional genetic algorithm (GA). For this, our approach minimizes the Kullback-Leibler divergence loss between the output from the RL policy model and a solution distribution obtained from the genetic solver. The key advantage of this approach is that the router can learn a policy in an offline setting with supervision, while improving the run-time performance nearly 100x over the genetic solver. Moreover, the quality of the solutions our approach produces matches well with those generated by GA. We show that especially for complex problems, our supervised RL method provides good quality solution similar to conventional attention-based RL without comprising run time performance. The ability to learn from example designs and train the router to get similar solutions with orders of magnitude run-time improvement can impact the design flow dramatically, potentially enabling increased design exploration and routability-driven placement.

READ FULL TEXT
research
04/20/2020

Attention Routing: track-assignment detailed routing using attention-based reinforcement learning

In the physical design of integrated circuits, global and detailed routi...
research
11/15/2020

Placement in Integrated Circuits using Cyclic Reinforcement Learning and Simulated Annealing

Physical design and production of Integrated Circuits (IC) is becoming i...
research
03/29/2022

Transformer Network-based Reinforcement Learning Method for Power Distribution Network (PDN) Optimization of High Bandwidth Memory (HBM)

In this article, for the first time, we propose a transformer network-ba...
research
03/31/2020

Attack of the Genes: Finding Keys and Parameters of Locked Analog ICs Using Genetic Algorithm

Hardware intellectual property (IP) theft is a major issue in today's gl...
research
10/01/2021

DNN-Opt: An RL Inspired Optimization for Analog Circuit Sizing using Deep Neural Networks

Analog circuit sizing takes a significant amount of manual effort in a t...
research
11/25/2019

Learning to Optimize Variational Quantum Circuits to Solve Combinatorial Problems

Quantum computing is a computational paradigm with the potential to outp...
research
09/09/2022

Location-Routing Planning for Last-Mile Deliveries Using Mobile Parcel Lockers: A Hybrid Q-Learning Network Approach

Mobile parcel lockers (MPLs) have been recently proposed by logistics op...

Please sign up or login with your details

Forgot password? Click here to reset