Neural Schrödinger Bridge with Sinkhorn Losses: Application to Data-driven Minimum Effort Control of Colloidal Self-assembly

07/26/2023
by   Iman Nodozi, et al.
0

We show that the minimum effort control of colloidal self-assembly can be naturally formulated in the order-parameter space as a generalized Schrödinger bridge problem – a class of fixed-horizon stochastic optimal control problems that originated in the works of Erwin Schrödinger in the early 1930s. In recent years, this class of problems has seen a resurgence of research activities in control and machine learning communities. Different from the existing literature on the theory and computation for such problems, the controlled drift and diffusion coefficients for colloidal self-assembly are typically non-affine in control, and are difficult to obtain from physics-based modeling. We deduce the conditions of optimality for such generalized problems, and show that the resulting system of equations is structurally very different from the existing results in a way that standard computational approaches no longer apply. Thus motivated, we propose a data-driven learning and control framework, named `neural Schrödinger bridge', to solve such generalized Schrödinger bridge problems by innovating on recent advances in neural networks. We illustrate the effectiveness of the proposed framework using a numerical case study of colloidal self-assembly. We learn the controlled drift and diffusion coefficients as two neural networks using molecular dynamics simulation data, and then use these two to train a third network with Sinkhorn losses designed for distributional endpoint constraints, specific for this class of control problems.

READ FULL TEXT

page 1

page 10

research
08/19/2022

A Physics-informed Deep Learning Approach for Minimum Effort Stochastic Control of Colloidal Self-Assembly

We propose formulating the finite-horizon stochastic optimal control pro...
research
09/12/2023

On the Contraction Coefficient of the Schrödinger Bridge for Stochastic Linear Systems

Schrödinger bridge is a stochastic optimal control problem to steer a gi...
research
03/31/2020

Reflected Schrödinger Bridge: Density Control with Path Constraints

How to steer a given joint state probability density function to another...
research
12/18/2019

Learning to grow: control of materials self-assembly using evolutionary reinforcement learning

We show that neural networks trained by evolutionary reinforcement learn...
research
12/11/2019

Mean-Field Neural ODEs via Relaxed Optimal Control

We develop a framework for the analysis of deep neural networks and neur...
research
09/20/2023

Drift Control of High-Dimensional RBM: A Computational Method Based on Neural Networks

Motivated by applications in queueing theory, we consider a stochastic c...
research
11/09/2019

Optimal Shape Control via L_∞ Loss for Composite Fuselage Assembly

Shape control is critical to ensure the quality of composite fuselage as...

Please sign up or login with your details

Forgot password? Click here to reset