PREF: Phasorial Embedding Fields for Compact Neural Representations

05/26/2022
by   Binbin Huang, et al.
4

We present a phasorial embedding field PREF as a compact representation to facilitate neural signal modeling and reconstruction tasks. Pure multi-layer perceptron (MLP) based neural techniques are biased towards low frequency signals and have relied on deep layers or Fourier encoding to avoid losing details. PREF instead employs a compact and physically explainable encoding field based on the phasor formulation of the Fourier embedding space. We conduct comprehensive experiments to demonstrate the advantages of PREF over the latest spatial embedding techniques. We then develop a highly efficient frequency learning framework using an approximated inverse Fourier transform scheme for PREF along with a novel Parseval regularizer. Extensive experiments show our efficient and compact frequency-based neural signal processing technique is on par with and even better than the state-of-the-art in 2D image completion, 3D SDF surface regression, and 5D radiance field reconstruction.

READ FULL TEXT

page 2

page 4

page 6

page 8

page 11

page 14

page 15

page 16

research
12/04/2022

Neural Fourier Filter Bank

We present a novel method to provide efficient and highly detailed recon...
research
08/06/2023

FourLLIE: Boosting Low-Light Image Enhancement by Fourier Frequency Information

Recently, Fourier frequency information has attracted much attention in ...
research
10/11/2016

Quantum spectral analysis: frequency at time (a lecture)

A quantum time-dependent spectrum analysis, or simply, quantum spectral ...
research
12/02/2022

QFF: Quantized Fourier Features for Neural Field Representations

Multilayer perceptrons (MLPs) learn high frequencies slowly. Recent appr...
research
07/06/2020

Joint Frequency- and Image-Space Learning for Fourier Imaging

We propose a neural network layer structure that combines frequency and ...
research
02/02/2023

Factor Fields: A Unified Framework for Neural Fields and Beyond

We present Factor Fields, a novel framework for modeling and representin...
research
12/18/2022

Masked Wavelet Representation for Compact Neural Radiance Fields

Neural radiance fields (NeRF) have demonstrated the potential of coordin...

Please sign up or login with your details

Forgot password? Click here to reset