WIRE: Wavelet Implicit Neural Representations

01/05/2023
by   Vishwanath Saragadam, et al.
0

Implicit neural representations (INRs) have recently advanced numerous vision-related areas. INR performance depends strongly on the choice of the nonlinear activation function employed in its multilayer perceptron (MLP) network. A wide range of nonlinearities have been explored, but, unfortunately, current INRs designed to have high accuracy also suffer from poor robustness (to signal noise, parameter variation, etc.). Inspired by harmonic analysis, we develop a new, highly accurate and robust INR that does not exhibit this tradeoff. Wavelet Implicit neural REpresentation (WIRE) uses a continuous complex Gabor wavelet activation function that is well-known to be optimally concentrated in space-frequency and to have excellent biases for representing images. A wide range of experiments (image denoising, image inpainting, super-resolution, computed tomography reconstruction, image overfitting, and novel view synthesis with neural radiance fields) demonstrate that WIRE defines the new state of the art in INR accuracy, training time, and robustness.

READ FULL TEXT

page 6

page 7

page 8

page 9

page 12

page 14

page 15

page 16

research
09/29/2021

Neural Knitworks: Patched Neural Implicit Representation Networks

Coordinate-based Multilayer Perceptron (MLP) networks, despite being cap...
research
09/10/2016

Rectifier Neural Network with a Dual-Pathway Architecture for Image Denoising

Recently deep neural networks based on tanh activation function have sho...
research
08/09/2023

TSSR: A Truncated and Signed Square Root Activation Function for Neural Networks

Activation functions are essential components of neural networks. In thi...
research
07/30/2018

Multi-bin Trainable Linear Unit for Fast Image Restoration Networks

Tremendous advances in image restoration tasks such as denoising and sup...
research
05/19/2022

Mip-NeRF RGB-D: Depth Assisted Fast Neural Radiance Fields

Neural scene representations, such as neural radiance fields (NeRF), are...
research
11/14/2018

Drop-Activation: Implicit Parameter Reduction and Harmonic Regularization

Overfitting frequently occurs in deep learning. In this paper, we propos...
research
09/12/2013

Modeling Based on Elman Wavelet Neural Network for Class-D Power Amplifiers

In Class-D Power Amplifiers (CDPAs), the power supply noise can intermod...

Please sign up or login with your details

Forgot password? Click here to reset