Neuromechanical Autoencoders: Learning to Couple Elastic and Neural Network Nonlinearity

01/31/2023
by   Deniz Oktay, et al.
0

Intelligent biological systems are characterized by their embodiment in a complex environment and the intimate interplay between their nervous systems and the nonlinear mechanical properties of their bodies. This coordination, in which the dynamics of the motor system co-evolved to reduce the computational burden on the brain, is referred to as “mechanical intelligence” or “morphological computation”. In this work, we seek to develop machine learning analogs of this process, in which we jointly learn the morphology of complex nonlinear elastic solids along with a deep neural network to control it. By using a specialized differentiable simulator of elastic mechanics coupled to conventional deep learning architectures – which we refer to as neuromechanical autoencoders – we are able to learn to perform morphological computation via gradient descent. Key to our approach is the use of mechanical metamaterials – cellular solids, in particular – as the morphological substrate. Just as deep neural networks provide flexible and massively-parametric function approximators for perceptual and control tasks, cellular solid metamaterials are promising as a rich and learnable space for approximating a variety of actuation tasks. In this work we take advantage of these complementary computational concepts to co-design materials and neural network controls to achieve nonintuitive mechanical behavior. We demonstrate in simulation how it is possible to achieve translation, rotation, and shape matching, as well as a “digital MNIST” task. We additionally manufacture and evaluate one of the designs to verify its real-world behavior.

READ FULL TEXT

page 5

page 6

page 7

page 8

page 9

page 15

page 16

research
04/04/2022

Deep learning for the rare-event rational design of 3D printed multi-material mechanical metamaterials

Emerging multi-material 3D printing techniques have paved the way for th...
research
04/19/2022

Binary Multi Channel Morphological Neural Network

Neural networks and particularly Deep learning have been comparatively l...
research
06/10/2022

GD-VAEs: Geometric Dynamic Variational Autoencoders for Learning Nonlinear Dynamics and Dimension Reductions

We develop data-driven methods incorporating geometric and topological i...
research
10/22/2019

Modeling plate and spring reverberation using a DSP-informed deep neural network

Plate and spring reverberators are electromechanical systems first used ...
research
12/01/2015

Evaluating Morphological Computation in Muscle and DC-motor Driven Models of Human Hopping

In the context of embodied artificial intelligence, morphological comput...
research
02/24/2022

Learning the nonlinear dynamics of soft mechanical metamaterials with graph networks

The dynamics of soft mechanical metamaterials provides opportunities for...

Please sign up or login with your details

Forgot password? Click here to reset