Polynomial Neural Fields for Subband Decomposition and Manipulation

02/09/2023
by   Guandao Yang, et al.
3

Neural fields have emerged as a new paradigm for representing signals, thanks to their ability to do it compactly while being easy to optimize. In most applications, however, neural fields are treated like black boxes, which precludes many signal manipulation tasks. In this paper, we propose a new class of neural fields called polynomial neural fields (PNFs). The key advantage of a PNF is that it can represent a signal as a composition of a number of manipulable and interpretable components without losing the merits of neural fields representation. We develop a general theoretical framework to analyze and design PNFs. We use this framework to design Fourier PNFs, which match state-of-the-art performance in signal representation tasks that use neural fields. In addition, we empirically demonstrate that Fourier PNFs enable signal manipulation applications such as texture transfer and scale-space interpolation. Code is available at https://github.com/stevenygd/PNF.

READ FULL TEXT

page 6

page 8

page 9

page 10

page 27

page 30

research
01/12/2022

Neural Residual Flow Fields for Efficient Video Representations

Implicit neural representation (INR) has emerged as a powerful paradigm ...
research
10/09/2022

Towards Efficient Neural Scene Graphs by Learning Consistency Fields

Neural Radiance Fields (NeRF) achieves photo-realistic image rendering f...
research
02/02/2023

Factor Fields: A Unified Framework for Neural Fields and Beyond

We present Factor Fields, a novel framework for modeling and representin...
research
07/20/2022

Streamable Neural Fields

Neural fields have emerged as a new data representation paradigm and hav...
research
05/30/2022

Compressible-composable NeRF via Rank-residual Decomposition

Neural Radiance Field (NeRF) has emerged as a compelling method to repre...
research
06/15/2022

Variable Bitrate Neural Fields

Neural approximations of scalar and vector fields, such as signed distan...
research
03/20/2023

Polynomial Implicit Neural Representations For Large Diverse Datasets

Implicit neural representations (INR) have gained significant popularity...

Please sign up or login with your details

Forgot password? Click here to reset