Modelling Long Range Dependencies in N-D: From Task-Specific to a General Purpose CNN

01/25/2023
by   David M. Knigge, et al.
0

Performant Convolutional Neural Network (CNN) architectures must be tailored to specific tasks in order to consider the length, resolution, and dimensionality of the input data. In this work, we tackle the need for problem-specific CNN architectures. We present the Continuous Convolutional Neural Network (CCNN): a single CNN able to process data of arbitrary resolution, dimensionality and length without any structural changes. Its key component are its continuous convolutional kernels which model long-range dependencies at every layer, and thus remove the need of current CNN architectures for task-dependent downsampling and depths. We showcase the generality of our method by using the same architecture for tasks on sequential (1 D), visual (2 D) and point-cloud (3 D) data. Our CCNN matches and often outperforms the current state-of-the-art across all tasks considered.

READ FULL TEXT

page 6

page 16

page 19

research
06/07/2022

Towards a General Purpose CNN for Long Range Dependencies in ND

The use of Convolutional Neural Networks (CNNs) is widespread in Deep Le...
research
06/06/2017

A General-Purpose Tagger with Convolutional Neural Networks

We present a general-purpose tagger based on convolutional neural networ...
research
10/24/2022

A Continuous Convolutional Trainable Filter for Modelling Unstructured Data

Convolutional Neural Network (CNN) is one of the most important architec...
research
04/22/2019

Linked Dynamic Graph CNN: Learning on Point Cloud via Linking Hierarchical Features

Learning on point cloud is eagerly in demand because the point cloud is ...
research
01/25/2018

NDDR-CNN: Layer-wise Feature Fusing in Multi-Task CNN by Neural Discriminative Dimensionality Reduction

State-of-the-art Convolutional Neural Network (CNN) benefits a lot from ...
research
02/16/2020

ArcText: A Unified Text Approach to Describing Convolutional Neural Network Architectures

Numerous Convolutional Neural Network (CNN) models have demonstrated the...
research
08/28/2018

Disfluency Detection using Auto-Correlational Neural Networks

In recent years, the natural language processing community has moved awa...

Please sign up or login with your details

Forgot password? Click here to reset