Implicit Neural Representations for Image Compression

12/08/2021
by   Yannick Strümpler, et al.
0

Recently Implicit Neural Representations (INRs) gained attention as a novel and effective representation for various data types. Thus far, prior work mostly focused on optimizing their reconstruction performance. This work investigates INRs from a novel perspective, i.e., as a tool for image compression. To this end, we propose the first comprehensive compression pipeline based on INRs including quantization, quantization-aware retraining and entropy coding. Encoding with INRs, i.e. overfitting to a data sample, is typically orders of magnitude slower. To mitigate this drawback, we leverage meta-learned initializations based on MAML to reach the encoding in fewer gradient updates which also generally improves rate-distortion performance of INRs. We find that our approach to source compression with INRs vastly outperforms similar prior work, is competitive with common compression algorithms designed specifically for images and closes the gap to state-of-the-art learned approaches based on Rate-Distortion Autoencoders. Moreover, we provide an extensive ablation study on the importance of individual components of our method which we hope facilitates future research on this novel approach to image compression.

READ FULL TEXT

page 5

page 7

page 15

page 16

page 17

page 18

research
08/27/2022

Lossy Image Compression with Quantized Hierarchical VAEs

Recent work has shown a strong theoretical connection between variationa...
research
04/15/2022

Self-Similarity Priors: Neural Collages as Differentiable Fractal Representations

Many patterns in nature exhibit self-similarity: they can be compactly d...
research
05/30/2023

Compression with Bayesian Implicit Neural Representations

Many common types of data can be represented as functions that map coord...
research
05/18/2020

Deep Implicit Volume Compression

We describe a novel approach for compressing truncated signed distance f...
research
11/18/2022

CNeRV: Content-adaptive Neural Representation for Visual Data

Compression and reconstruction of visual data have been widely studied i...
research
11/17/2021

End-to-end optimized image compression with competition of prior distributions

Convolutional autoencoders are now at the forefront of image compression...
research
09/19/2023

Semantic Text Compression for Classification

We study semantic compression for text where meanings contained in the t...

Please sign up or login with your details

Forgot password? Click here to reset