Hybrid-DNNs: Hybrid Deep Neural Networks for Mixed Inputs

05/18/2020
by   Zhenyu Yuan, et al.
0

Rapid development of big data and high-performance computing have encouraged explosive studies of deep learning in geoscience. However, most studies only take single-type data as input, frittering away invaluable multisource, multi-scale information. We develop a general architecture of hybrid deep neural networks (HDNNs) to support mixed inputs. Regarding as a combination of feature learning and target learning, the new proposed networks provide great capacity in high-hierarchy feature extraction and in-depth data mining. Furthermore, the hybrid architecture is an aggregation of multiple networks, demonstrating good flexibility and wide applicability. The configuration of multiple networks depends on application tasks and varies with inputs and targets. Concentrating on reservoir production prediction, a specific HDNN model is configured and applied to an oil development block. Considering their contributions to hydrocarbon production, core photos, logging images and curves, geologic and engineering parameters can all be taken as inputs. After preprocessing, the mixed inputs are prepared as regular-sampled structural and numerical data. For feature learning, convolutional neural networks (CNN) and multilayer perceptron (MLP) network are configured to separately process structural and numerical inputs. Learned features are then concatenated and fed to subsequent networks for target learning. Comparison with typical MLP model and CNN model highlights the superiority of proposed HDNN model with high accuracy and good generalization.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/11/2015

Efficient Deep Feature Learning and Extraction via StochasticNets

Deep neural networks are a powerful tool for feature learning and extrac...
research
06/03/2022

A Theoretical Analysis on Feature Learning in Neural Networks: Emergence from Inputs and Advantage over Fixed Features

An important characteristic of neural networks is their ability to learn...
research
02/24/2023

Hybrid machine-learned homogenization: Bayesian data mining and convolutional neural networks

Beyond the generally deployed features for microstructure property predi...
research
08/17/2020

Bayesian deep learning for mapping via auxiliary information: a new era for geostatistics?

For geospatial modelling and mapping tasks, variants of kriging - the sp...
research
06/24/2023

Graph Neural Networks Provably Benefit from Structural Information: A Feature Learning Perspective

Graph neural networks (GNNs) have pioneered advancements in graph repres...
research
02/07/2019

Hybrid Models with Deep and Invertible Features

We propose a neural hybrid model consisting of a linear model defined on...
research
11/29/2018

Multi-Scale Distributed Representation for Deep Learning and its Application to b-Jet Tagging

Recently machine learning algorithms based on deep layered artificial ne...

Please sign up or login with your details

Forgot password? Click here to reset