DNN-Based Topology Optimisation: Spatial Invariance and Neural Tangent Kernel

06/10/2021
by   Benjamin Dupuis, et al.
0

We study the SIMP method with a density field generated by a fully-connected neural network, taking the coordinates as inputs. In the large width limit, we show that the use of DNNs leads to a filtering effect similar to traditional filtering techniques for SIMP, with a filter described by the Neural Tangent Kernel (NTK). This filter is however not invariant under translation, leading to visual artifacts and non-optimal shapes. We propose two embeddings of the input coordinates, which lead to (approximate) spatial invariance of the NTK and of the filter. We empirically confirm our theoretical observations and study how the filter size is affected by the architecture of the network. Our solution can easily be applied to any other coordinates-based generation method.

READ FULL TEXT

page 6

page 8

page 22

research
03/18/2021

Stride and Translation Invariance in CNNs

Convolutional Neural Networks have become the standard for image classif...
research
02/07/2020

Revisiting Spatial Invariance with Low-Rank Local Connectivity

Convolutional neural networks are among the most successful architecture...
research
11/06/2018

Fast Adaptive Bilateral Filtering

In the classical bilateral filter, a fixed Gaussian range kernel is used...
research
04/13/2021

Tracking translation invariance in CNNs

Although Convolutional Neural Networks (CNNs) are widely used, their tra...
research
06/27/2022

Insights into Deep Non-linear Filters for Improved Multi-channel Speech Enhancement

The key advantage of using multiple microphones for speech enhancement i...
research
07/11/2023

Merging multiple input descriptors and supervisors in a deep neural network for tractogram filtering

One of the main issues of the current tractography methods is their high...
research
10/17/2017

A Deep Learning Approach for Reconstruction Filter Kernel Discretization

In this paper, we present substantial evidence that a deep neural networ...

Please sign up or login with your details

Forgot password? Click here to reset