Regularize implicit neural representation by itself

03/27/2023
by   Zhemin Li, et al.
0

This paper proposes a regularizer called Implicit Neural Representation Regularizer (INRR) to improve the generalization ability of the Implicit Neural Representation (INR). The INR is a fully connected network that can represent signals with details not restricted by grid resolution. However, its generalization ability could be improved, especially with non-uniformly sampled data. The proposed INRR is based on learned Dirichlet Energy (DE) that measures similarities between rows/columns of the matrix. The smoothness of the Laplacian matrix is further integrated by parameterizing DE with a tiny INR. INRR improves the generalization of INR in signal representation by perfectly integrating the signal's self-similarity with the smoothness of the Laplacian matrix. Through well-designed numerical experiments, the paper also reveals a series of properties derived from INRR, including momentum methods like convergence trajectory and multi-scale similarity. Moreover, the proposed method could improve the performance of other signal representation methods.

READ FULL TEXT

page 2

page 3

page 5

page 7

page 8

page 12

page 13

research
02/07/2022

MINER: Multiscale Implicit Neural Representations

We introduce a new neural signal representation designed for the efficie...
research
05/24/2018

Laplacian Power Networks: Bounding Indicator Function Smoothness for Adversarial Defense

Deep Neural Networks often suffer from lack of robustness to adversarial...
research
01/13/2022

Convolutional dual graph Laplacian sparse coding

In recent years, graph signal processing (GSP) technology has become pop...
research
03/13/2020

Can Implicit Bias Explain Generalization? Stochastic Convex Optimization as a Case Study

The notion of implicit bias, or implicit regularization, has been sugges...
research
07/08/2022

Neural Implicit Dictionary via Mixture-of-Expert Training

Representing visual signals by coordinate-based deep fully-connected net...
research
03/18/2022

Soft Smoothness for Audio Inpainting Using a Latent Matrix Model in Delay-embedded Space

Here, we propose a new reconstruction method of smooth time-series signa...
research
10/12/2021

AIR-Net: Adaptive and Implicit Regularization Neural Network for Matrix Completion

Conventionally, the matrix completion (MC) model aims to recover a matri...

Please sign up or login with your details

Forgot password? Click here to reset