Switchblade – a Neural Network for Hard 2D Tasks

06/29/2020
by   Emīls Ozoliņš, et al.
0

Convolutional neural networks have become the main tools for processing two-dimensional data. They work well for images, yet convolutions have a limited receptive field that prevents its applications to more complex 2D tasks. We propose a new neural network model, named Switchblade, that can efficiently exploit long-range dependencies in 2D data and solve much more challenging tasks. It has close-to-optimal 𝒪(n^2 logn) complexity for processing n × n data matrix. Besides the common image classification and segmentation, we consider a diverse set of algorithmic tasks on matrices and graphs. Switchblade can infer highly complex matrix squaring and graph triangle finding algorithms purely from input-output examples. We show that our model is likewise suitable for logical reasoning tasks – it attains perfect accuracy on Sudoku puzzle solving. Additionally, we introduce a new dataset for predicting the checkmating move in chess on which our model achieves 72.5

READ FULL TEXT

page 7

page 15

research
07/18/2019

Neural Shuffle-Exchange Networks - Sequence Processing in O(n log n) Time

A key requirement in sequence to sequence processing is the modeling of ...
research
07/07/2015

Dependency-based Convolutional Neural Networks for Sentence Embedding

In sentence modeling and classification, convolutional neural network ap...
research
06/27/2019

Dealing with Topological Information within a Fully Convolutional Neural Network

A fully convolutional neural network has a receptive field of limited si...
research
06/30/2022

Learning Iterative Reasoning through Energy Minimization

Deep learning has excelled on complex pattern recognition tasks such as ...
research
06/07/2022

Towards a General Purpose CNN for Long Range Dependencies in ND

The use of Convolutional Neural Networks (CNNs) is widespread in Deep Le...
research
02/11/2022

End-to-end Algorithm Synthesis with Recurrent Networks: Logical Extrapolation Without Overthinking

Machine learning systems perform well on pattern matching tasks, but the...
research
12/19/2018

Multitask Painting Categorization by Deep Multibranch Neural Network

In this work we propose a new deep multibranch neural network to solve t...

Please sign up or login with your details

Forgot password? Click here to reset