Learning from flowsheets: A generative transformer model for autocompletion of flowsheets

08/01/2022
by   Gabriel Vogel, et al.
0

We propose a novel method enabling autocompletion of chemical flowsheets. This idea is inspired by the autocompletion of text. We represent flowsheets as strings using the text-based SFILES 2.0 notation and learn the grammatical structure of the SFILES 2.0 language and common patterns in flowsheets using a transformer-based language model. We pre-train our model on synthetically generated flowsheets to learn the flowsheet language grammar. Then, we fine-tune our model in a transfer learning step on real flowsheet topologies. Finally, we use the trained model for causal language modeling to autocomplete flowsheets. Eventually, the proposed method can provide chemical engineers with recommendations during interactive flowsheet synthesis. The results demonstrate a high potential of this approach for future AI-assisted process synthesis.

READ FULL TEXT
research
07/25/2022

SFILES 2.0: An extended text-based flowsheet representation

SFILES is a text-based notation for chemical process flowsheets. It was ...
research
02/27/2021

Generative chemical transformer: attention makes neural machine learn molecular geometric structures via text

Chemical formula is an artificial language that expresses molecules as t...
research
07/07/2020

The Go Transformer: Natural Language Modeling for Game Play

This work applies natural language modeling to generate plausible strate...
research
02/08/2023

Auto-Learning: An Adversarial Process of Two Pre-trained Models for Natural Language Generation

Pre-trained models have been used in many fields in recent years, rangin...
research
10/12/2021

Deep Learning for Bias Detection: From Inception to Deployment

To create a more inclusive workplace, enterprises are actively investing...
research
07/13/2023

In-context Autoencoder for Context Compression in a Large Language Model

We propose the In-context Autoencoder (ICAE) for context compression in ...

Please sign up or login with your details

Forgot password? Click here to reset