6DCNN with roto-translational convolution filters for volumetric data processing

07/26/2021
by   Dmitrii Zhemchuzhnikov, et al.
0

In this work, we introduce 6D Convolutional Neural Network (6DCNN) designed to tackle the problem of detecting relative positions and orientations of local patterns when processing three-dimensional volumetric data. 6DCNN also includes SE(3)-equivariant message-passing and nonlinear activation operations constructed in the Fourier space. Working in the Fourier space allows significantly reducing the computational complexity of our operations. We demonstrate the properties of the 6D convolution and its efficiency in the recognition of spatial patterns. We also assess the 6DCNN model on several datasets from the recent CASP protein structure prediction challenges. Here, 6DCNN improves over the baseline architecture and also outperforms the state of the art.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/16/2020

Spherical convolutions on molecular graphs for protein model quality assessment

Processing information on 3D objects requires methods stable to rigid-bo...
research
08/09/2023

Volumetric Fast Fourier Convolution for Detecting Ink on the Carbonized Herculaneum Papyri

Recent advancements in Digital Document Restoration (DDR) have led to si...
research
05/14/2019

3D Dense Separated Convolution Module for Volumetric Image Analysis

With the thriving of deep learning, 3D Convolutional Neural Networks hav...
research
09/21/2018

Analysis of Irregular Spatial Data with Machine Learning: Classification of Building Patterns with a Graph Convolutional Neural Network

Machine learning methods such as convolutional neural networks (CNNs) ar...
research
06/15/2017

Holistic Planimetric prediction to Local Volumetric prediction for 3D Human Pose Estimation

We propose a novel approach to 3D human pose estimation from a single de...
research
12/23/2021

Batch Processing and Data Streaming Fourier-based Convolutional Neural Network Accelerator

Decision-making by artificial neural networks with minimal latency is pa...
research
12/13/2018

Fourier RNNs for Sequence Analysis and Prediction

Fourier methods have a long and proven track record in as an excellent t...

Please sign up or login with your details

Forgot password? Click here to reset