HiDeNN-PGD: reduced-order hierarchical deep learning neural networks

05/13/2021
by   Lei Zhang, et al.
7

This paper presents a proper generalized decomposition (PGD) based reduced-order model of hierarchical deep-learning neural networks (HiDeNN). The proposed HiDeNN-PGD method keeps both advantages of HiDeNN and PGD methods. The automatic mesh adaptivity makes the HiDeNN-PGD more accurate than the finite element method (FEM) and conventional PGD, using a fraction of the FEM degrees of freedom. The accuracy and convergence of the method have been studied theoretically and numerically, with a comparison to different methods, including FEM, PGD, HiDeNN and Deep Neural Networks. In addition, we theoretically showed that the PGD converges to FEM at increasing modes, and the PGD error is a direct sum of the FEM error and the mode reduction error. The proposed HiDeNN-PGD performs high accuracy with orders of magnitude fewer degrees of freedom, which shows a high potential to achieve fast computations with a high level of accuracy for large-size engineering problems.

READ FULL TEXT

page 4

page 10

page 18

page 19

page 32

research
03/30/2016

Degrees of Freedom in Deep Neural Networks

In this paper, we explore degrees of freedom in deep sigmoidal neural ne...
research
01/24/2023

A predictive physics-aware hybrid reduced order model for reacting flows

In this work, a new hybrid predictive Reduced Order Model (ROM) is propo...
research
02/19/2023

Rank-Minimizing and Structured Model Inference

While extracting information from data with machine learning plays an in...
research
04/28/2021

Computing leaky modes of optical fibers using a FEAST algorithm for polynomial eigenproblems

An efficient technique to solve polynomial eigenproblems is shown to res...
research
12/17/2019

Balancing truncation and round-off errors in practical FEM: one-dimensional analysis

In finite element methods (FEMs), the accuracy of the solution cannot in...
research
12/31/2021

Separation of scales and a thermodynamic description of feature learning in some CNNs

Deep neural networks (DNNs) are powerful tools for compressing and disti...
research
01/31/2023

Physics-informed Reduced-Order Learning from the First Principles for Simulation of Quantum Nanostructures

Multi-dimensional direct numerical simulation (DNS) of the Schrödinger e...

Please sign up or login with your details

Forgot password? Click here to reset