Streamable Neural Fields

07/20/2022
by   Junwoo Cho, et al.
0

Neural fields have emerged as a new data representation paradigm and have shown remarkable success in various signal representations. Since they preserve signals in their network parameters, the data transfer by sending and receiving the entire model parameters prevents this emerging technology from being used in many practical scenarios. We propose streamable neural fields, a single model that consists of executable sub-networks of various widths. The proposed architectural and training techniques enable a single network to be streamable over time and reconstruct different qualities and parts of signals. For example, a smaller sub-network produces smooth and low-frequency signals, while a larger sub-network can represent fine details. Experimental results have shown the effectiveness of our method in various domains, such as 2D images, videos, and 3D signed distance functions. Finally, we demonstrate that our proposed method improves training stability, by exploiting parameter sharing.

READ FULL TEXT

page 2

page 11

page 21

page 24

page 25

page 26

page 28

page 29

research
01/12/2022

Neural Residual Flow Fields for Efficient Video Representations

Implicit neural representation (INR) has emerged as a powerful paradigm ...
research
09/06/2023

ResFields: Residual Neural Fields for Spatiotemporal Signals

Neural fields, a category of neural networks trained to represent high-f...
research
02/09/2023

Polynomial Neural Fields for Subband Decomposition and Manipulation

Neural fields have emerged as a new paradigm for representing signals, t...
research
03/29/2023

HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusion

Implicit neural fields, typically encoded by a multilayer perceptron (ML...
research
06/17/2020

Implicit Neural Representations with Periodic Activation Functions

Implicitly defined, continuous, differentiable signal representations pa...
research
01/16/2018

Deep Network for Simultaneous Decomposition and Classification in UWB-SAR Imagery

Classifying buried and obscured targets of interest from other natural a...

Please sign up or login with your details

Forgot password? Click here to reset