Closed-Loop Control of Direct Ink Writing via Reinforcement Learning

01/27/2022
by   Michal Piovarci, et al.
0

Enabling additive manufacturing to employ a wide range of novel, functional materials can be a major boost to this technology. However, making such materials printable requires painstaking trial-and-error by an expert operator, as they typically tend to exhibit peculiar rheological or hysteresis properties. Even in the case of successfully finding the process parameters, there is no guarantee of print-to-print consistency due to material differences between batches. These challenges make closed-loop feedback an attractive option where the process parameters are adjusted on-the-fly. There are several challenges for designing an efficient controller: the deposition parameters are complex and highly coupled, artifacts occur after long time horizons, simulating the deposition is computationally costly, and learning on hardware is intractable. In this work, we demonstrate the feasibility of learning a closed-loop control policy for additive manufacturing using reinforcement learning. We show that approximate, but efficient, numerical simulation is sufficient as long as it allows learning the behavioral patterns of deposition that translate to real-world experiences. In combination with reinforcement learning, our model can be used to discover control policies that outperform baseline controllers. Furthermore, the recovered policies have a minimal sim-to-real gap. We showcase this by applying our control policy in-vivo on a single-layer, direct ink writing printer.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

page 10

page 12

page 13

research
05/07/2018

3D printing of a leaf spring: A demonstration of closed-loop control in additive manufacturing

This paper presents the integration of a feedback control loop during th...
research
09/12/2020

Guided Policy Search Based Control of a High Dimensional Advanced Manufacturing Process

In this paper we apply guided policy search (GPS) based reinforcement le...
research
03/30/2021

Learning Robust Feedback Policies from Demonstrations

In this work we propose and analyze a new framework to learn feedback co...
research
08/31/2022

A stabilizing reinforcement learning approach for sampled systems with partially unknown models

Reinforcement learning is commonly associated with training of reward-ma...
research
06/19/2020

A Reinforcement Learning Approach for Transient Control of Liquid Rocket Engines

Nowadays, liquid rocket engines use closed-loop control at most near ste...
research
07/13/2023

Hybrid Control Policy for Artificial Pancreas via Ensemble Deep Reinforcement Learning

Objective: The artificial pancreas (AP) has shown promising potential in...
research
03/03/2021

Learning to Manipulate Amorphous Materials

We present a method of training character manipulation of amorphous mate...

Please sign up or login with your details

Forgot password? Click here to reset