Log In Sign Up

Reinforced Molecular Optimization with Neighborhood-Controlled Grammars

by   Chencheng Xu, et al.

A major challenge in the pharmaceutical industry is to design novel molecules with specific desired properties, especially when the property evaluation is costly. Here, we propose MNCE-RL, a graph convolutional policy network for molecular optimization with molecular neighborhood-controlled embedding grammars through reinforcement learning. We extend the original neighborhood-controlled embedding grammars to make them applicable to molecular graph generation and design an efficient algorithm to infer grammatical production rules from given molecules. The use of grammars guarantees the validity of the generated molecular structures. By transforming molecular graphs to parse trees with the inferred grammars, the molecular structure generation task is modeled as a Markov decision process where a policy gradient strategy is utilized. In a series of experiments, we demonstrate that our approach achieves state-of-the-art performance in a diverse range of molecular optimization tasks and exhibits significant superiority in optimizing molecular properties with a limited number of property evaluations.


page 1

page 2

page 3

page 4


Graph Convolutional Policy Network for Goal-Directed Molecular Graph Generation

Generating novel graph structures that optimize given objectives while o...

MolecularRNN: Generating realistic molecular graphs with optimized properties

Designing new molecules with a set of predefined properties is a core pr...

Amortized Tree Generation for Bottom-up Synthesis Planning and Synthesizable Molecular Design

Molecular design and synthesis planning are two critical steps in the pr...

Graph Polish: A Novel Graph Generation Paradigm for Molecular Optimization

Molecular optimization, which transforms a given input molecule X into a...

Grammars and reinforcement learning for molecule optimization

We seek to automate the design of molecules based on specific chemical p...

Probabilistic hypergraph grammars for efficient molecular optimization

We present an approach to make molecular optimization more efficient. We...

Learning to Design RNA

Designing RNA molecules has garnered recent interest in medicine, synthe...