Analog Circuit Design with Dyna-Style Reinforcement Learning

11/16/2020
by   Wook Lee, et al.
0

In this work, we present a learning based approach to analog circuit design, where the goal is to optimize circuit performance subject to certain design constraints. One of the aspects that makes this problem challenging to optimize, is that measuring the performance of candidate configurations with simulation can be computationally expensive, particularly in the post-layout design. Additionally, the large number of design constraints and the interaction between the relevant quantities makes the problem complex. Therefore, to better facilitate supporting the human designers, it is desirable to gain knowledge about the whole space of feasible solutions. In order to tackle these challenges, we take inspiration from model-based reinforcement learning and propose a method with two key properties. First, it learns a reward model, i.e., surrogate model of the performance approximated by neural networks, to reduce the required number of simulation. Second, it uses a stochastic policy generator to explore the diverse solution space satisfying constraints. Together we combine these in a Dyna-style optimization framework, which we call DynaOpt, and empirically evaluate the performance on a circuit benchmark of a two-stage operational amplifier. The results show that, compared to the model-free method applied with 20,000 circuit simulations to train the policy, DynaOpt achieves even much better performance by learning from scratch with only 500 simulations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/26/2022

Domain Knowledge-Based Automated Analog Circuit Design with Deep Reinforcement Learning

The design automation of analog circuits is a longstanding challenge in ...
research
04/27/2022

Domain Knowledge-Infused Deep Learning for Automated Analog/Radio-Frequency Circuit Parameter Optimization

The design automation of analog circuits is a longstanding challenge. Th...
research
07/23/2019

BagNet: Berkeley Analog Generator with Layout Optimizer Boosted with Deep Neural Networks

The discrepancy between post-layout and schematic simulation results con...
research
09/29/2020

Fast Design Space Adaptation with Deep Reinforcement Learning for Analog Circuit Sizing

We present a novel framework for design space search on analog circuit s...
research
09/05/2022

Leveraging Layout-based Effects for Locking Analog ICs

While various obfuscation methods exist in the digital domain, technique...
research
12/05/2018

Learning to Design Circuits

Analog IC design relies on human experts to search for parameters that s...
research
11/09/2017

Worm-level Control through Search-based Reinforcement Learning

Through natural evolution, nervous systems of organisms formed near-opti...

Please sign up or login with your details

Forgot password? Click here to reset